-- Logs begin at Thu 2021-05-20 15:26:25 UTC, end at Thu 2021-05-20 16:39:10 UTC. --
May 20 16:08:29.311862 dv-cinder-689486-13-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 20 16:08:31.752767 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.common.config [-] Logging enabled!
May 20 16:08:31.753384 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev221
May 20 16:08:31.753570 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92280) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 20 16:08:31.757033 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.common.config [-] Logging enabled!
May 20 16:08:31.757296 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev221
May 20 16:08:31.757615 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92280) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 20 16:08:31.758569 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 20 16:08:31.758803 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 20 16:08:31.759168 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 20 16:08:31.759434 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 20 16:08:31.759663 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 20 16:08:31.759983 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.760281 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.760580 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.760810 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.761107 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.761398 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.761682 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.761973 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.762273 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.762562 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.762845 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.763132 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.763459 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.763863 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.764038 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.764343 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.764549 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] debug                          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.764832 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.765385 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.765776 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.765963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.766256 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.766540 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.766807 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.767099 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.767403 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.767741 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] host                           = dv-cinder-689486-13-iscsi {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.768638 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.768880 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.769119 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.769392 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.769720 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.770019 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.770296 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.770566 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.770837 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.771259 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.771475 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.771706 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.772000 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.772229 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.772516 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.772741 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.773030 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.773309 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.773586 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.773862 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.774140 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.774429 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.774685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.774972 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.775280 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.775570 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.775884 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.776123 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.776396 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.776668 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.776956 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.777231 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.777504 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.777784 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.778069 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.778345 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.778619 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.778921 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.779229 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.779505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.779791 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.780067 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.780351 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.780625 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.780899 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.781171 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.781445 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.781716 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.782000 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.782274 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.782621 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.782820 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.783093 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.783432 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:31.784290 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.784595 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.784907 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.785197 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.785506 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.785788 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.786086 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.786368 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.786667 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.786962 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.787291 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.787576 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.787873 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.788185 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.788487 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.788798 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.789103 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.789400 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.789682 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.789963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.790242 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.790524 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.790819 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.791117 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.791441 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.791718 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.792008 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.792304 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.792589 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.792866 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.793149 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.793441 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.793726 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.794000 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.794287 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.794566 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.794845 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.795122 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.795441 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.795736 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.796021 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.796297 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.796572 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.796851 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.797126 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.797413 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.797693 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.797971 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.798248 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.798525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.798802 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.799126 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.799445 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.799727 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.800015 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.800292 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.800571 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.800846 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.801123 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.801399 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.801675 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.801950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.802230 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.802573 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.802765 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.803041 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.803343 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.803622 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.803913 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.804214 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.804500 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.804783 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.805068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.805351 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.805635 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.805918 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.806201 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.806482 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.806760 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.807057 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.807371 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.807666 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.807961 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.808245 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.808549 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.808833 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.809127 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.809414 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.809700 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.809996 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.810284 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.810584 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.810884 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.811215 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.811505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.811803 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.812087 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.812403 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.812687 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:31.812971 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 20 16:08:31.813154 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=92280) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 20 16:08:32.167853 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=92280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:08:32.168127 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=92280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:08:32.168418 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=92280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:08:32.168764 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [-] Loading core plugin: ml2
May 20 16:08:32.476203 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.476413 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.476688 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.477921 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.478193 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.478455 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.596722 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.597000 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.597274 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.610598 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.610862 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.611128 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.640494 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.640777 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.641047 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.680310 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.680587 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.680855 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.921526 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fe7142f44c0> agent after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.922278 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fe7142f44c0> agent after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.922278 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7fe7142f43a0> segment precommit_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.922471 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7fe7142e8790> network precommit_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:32.923062 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7fe714315f70> segment before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.050679 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> network before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.050993 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7fe7140d5c10> agent before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.051297 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> network before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.051579 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> port before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.051853 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> port before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.052165 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> segment precommit_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.052428 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> segment precommit_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.052688 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> segment after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.052940 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> segment after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.053224 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> network after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.053481 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> network precommit_delete 0 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.053746 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> port provisioning_complete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.054014 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.054277 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> rbac-policy after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.054540 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> agent after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.054810 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> subnet after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.055069 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> subnet precommit_delete 0 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.055512 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.055781 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.056070 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> segment_host_mapping after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.056431 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> port after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.056684 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> port after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.056934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> port after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.057218 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.057469 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.057717 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe714c37dc0>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.058103 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:33.058345 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:33.058581 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:33.058819 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:33.059055 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:33.059313 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:33.059681 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 20 16:08:33.062826 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 20 16:08:33.066785 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 20 16:08:33.070598 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(600, 649)])])
May 20 16:08:33.072245 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 20 16:08:33.072702 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 20 16:08:33.073042 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 20 16:08:33.073424 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 20 16:08:33.076405 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 20 16:08:33.076662 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 20 16:08:33.077014 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 20 16:08:33.105644 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 20 16:08:33.106094 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7fe714447310>> qos_plugin after_init 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.106392 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=92280) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 20 16:08:33.106761 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7fe714436bb0>> logging-plugin after_init 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.108138 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=92280) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 20 16:08:33.108423 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 20 16:08:33.108671 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 20 16:08:33.112445 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fe714436430>> floatingip before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.112723 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fe714436430>> port before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:33.182467 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 20 16:08:33.182626 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 20 16:08:33.182861 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 20 16:08:33.183270 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 20 16:08:33.214712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_db.sqlalchemy.engines [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 20 16:08:33.745856 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing driver for type 'gre'
May 20 16:08:33.746383 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] gre ID ranges: [(1, 1000)]
May 20 16:08:33.945802 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing driver for type 'local'
May 20 16:08:33.946462 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing driver for type 'vlan'
May 20 16:08:34.031936 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] VlanTypeDriver initialization complete
May 20 16:08:34.032396 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing driver for type 'vxlan'
May 20 16:08:34.032947 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] vxlan ID ranges: [(1, 1000)]
May 20 16:08:34.233463 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing extension driver 'port_security'
May 20 16:08:34.233803 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.extensions.port_security [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] PortSecurityExtensionDriver initialization complete
May 20 16:08:34.234132 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing mechanism driver 'openvswitch'
May 20 16:08:34.234461 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing mechanism driver 'hyperv'
May 20 16:08:34.241685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.plugins.ml2.plugin [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=92280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:08:34.242466 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe7142c3b50>> port after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.242844 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe7142c3b50>> port after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.243219 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe7142c3b50>> port after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.243658 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe7142c3ca0>> subnet after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.244025 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe7142c3ca0>> subnet after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.244368 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe7142c3ca0>> subnet after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.244814 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713caf790>> network after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.245164 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713caf790>> network after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.245509 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713caf790>> network after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.245889 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafa00>> security_group after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.246242 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafa00>> security_group after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.246581 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafa00>> security_group after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.246963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafc70>> security_group_rule after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.247356 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafc70>> security_group_rule after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.247723 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafc70>> security_group_rule after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.248088 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafee0>> address_group after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.248435 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafee0>> address_group after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.248771 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe713cafee0>> address_group after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.249150 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] ML2 OVO RPC backend initialized. {{(pid=92280) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 20 16:08:34.249924 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> router_interface after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.250285 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> router_interface after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.250704 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> network before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.251047 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> networks before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.251418 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> port before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.251758 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> ports before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.252740 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> subnet before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.253355 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> subnets before_response 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.253433 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> network after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.253752 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> network after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.254090 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> network after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.254429 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> port after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.254801 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> port after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.255216 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> port after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.260255 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> subnet after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.260255 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> subnet after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.260255 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe713cbd310>> subnet after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.260255 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.plugin [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Modular L2 Plugin initialization complete
May 20 16:08:34.260255 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading services supported by the core plugin {{(pid=92280) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 20 16:08:34.260634 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.plugins.ml2.managers [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Got port-security extension from driver 'port_security'
May 20 16:08:34.260634 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.extensions.vlantransparent [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Disabled vlantransparent extension.
May 20 16:08:34.260634 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=92280) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 20 16:08:34.260634 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: router
May 20 16:08:34.302624 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router_interface before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.302946 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router after_create 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.303367 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router before_create 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.303745 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router_interface before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.304123 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router_interface after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.304477 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router after_delete 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.304835 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> floatingip after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.305201 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router after_create 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.305547 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router after_update 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.305894 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router after_update 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.306239 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router_gateway after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.306641 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router after_update 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.307058 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router precommit_update 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.307454 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7fe714205b80> port after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.307793 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7fe714205ca0> port after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.308128 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7fe714205c10> subnet after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.308469 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7fe714205af0> subnetpool_address_scope after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.308812 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> port precommit_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.309190 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router precommit_create 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.309540 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7fe7141fdd30> port before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.309880 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router precommit_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.310232 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router after_update 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.310570 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router precommit_delete 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.310915 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router precommit_create 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.311331 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router_interface after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.311678 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> router precommit_update 55549900 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.312111 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe713cbd430>> network after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.313003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Tracking information for resource: router configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:34.313330 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Tracking information for resource: floatingip configured {{(pid=92280) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 16:08:34.319076 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.db.l3_agentschedulers_db [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 20 16:08:34.319680 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7fe713c74700> port after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.320042 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7fe713c745e0> port after_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.320394 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function _notify_port_delete at 0x7fe713c74670> port after_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.320745 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7fe713c749d0> port after_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.321550 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe713c8bc40>> router before_create 55550100 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.321906 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe713c8bc40>> router precommit_delete 55550100 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.322268 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe713c8bc40>> router precommit_create 55550100 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.322624 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe713c8bc40>> router precommit_update 55550100 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.327309 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.services.provider_configuration [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service providers = [] {{(pid=92280) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 20 16:08:34.327672 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.db.servicetype_db [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=92280) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 20 16:08:34.330690 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.services.service_base [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=92280) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 16:08:34.331030 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.services.service_base [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=92280) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 16:08:34.331398 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.services.service_base [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=92280) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 16:08:34.332311 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.services.service_base [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=92280) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 16:08:34.332682 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.services.service_base [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Default provider is not specified for service type L3_ROUTER_NAT
May 20 16:08:34.333243 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.333563 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 20 16:08:34.347686 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.347928 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: auto_allocate
May 20 16:08:34.353754 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fe713c32d30> network precommit_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.354126 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fe713c32d30> network precommit_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.354654 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.359682 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: tag
May 20 16:08:34.366989 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.367399 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: timestamp
May 20 16:08:34.371539 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.371867 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: network_ip_availability
May 20 16:08:34.377949 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe713c5af40>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.378335 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe713c5af40>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.378688 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe713c5af40>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.379510 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.379829 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: flavors
May 20 16:08:34.385208 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.385536 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading Plugin: revisions
May 20 16:08:34.390008 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=92280) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 16:08:34.390454 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_concurrency.lockutils [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.222s {{(pid=92280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:08:34.391267 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=92280) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 20 16:08:34.391642 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Initializing extension manager.
May 20 16:08:34.392213 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: __init__.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.392573 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: __pycache__ {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.392975 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.393414 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: address_group.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.429278 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.435509 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: address-group
May 20 16:08:34.435509 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: address_scope.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.435509 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.435509 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: address-scope
May 20 16:08:34.435509 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: admin_state_down_before_update.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.436260 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.436441 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: router-admin-state-down-before-update
May 20 16:08:34.436733 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: agent.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.437443 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.437950 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: agent
May 20 16:08:34.438502 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: agent_resources_synced.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.439215 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.439775 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: agent-resources-synced
May 20 16:08:34.440084 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: allowedaddresspairs.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.441985 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.442535 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: allowed-address-pairs
May 20 16:08:34.442862 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: auto_allocated_topology.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.444019 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.444596 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: auto-allocated-topology
May 20 16:08:34.444919 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: availability_zone.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.445699 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.446350 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: availability_zone
May 20 16:08:34.446703 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: availability_zone_filter.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.447760 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.448331 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: availability_zone_filter
May 20 16:08:34.448653 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: data_plane_status.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.449595 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.450209 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension data-plane-status not supported by any of loaded plugins
May 20 16:08:34.450631 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: default_subnetpools.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.451614 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.452170 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: default-subnetpools
May 20 16:08:34.452535 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: dhcpagentscheduler.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.453738 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.454794 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: dhcp_agent_scheduler
May 20 16:08:34.455360 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: dns.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.456449 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.457035 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension dns-integration not supported by any of loaded plugins
May 20 16:08:34.457366 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: dns_domain_ports.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.458302 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.458857 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension dns-domain-ports not supported by any of loaded plugins
May 20 16:08:34.459387 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: dvr.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.460150 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.460772 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: dvr
May 20 16:08:34.461239 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: empty_string_filtering.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.462479 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.464741 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: empty-string-filtering
May 20 16:08:34.464741 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.464906 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.465360 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 20 16:08:34.465750 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.466807 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.467706 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 20 16:08:34.468175 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: external_net.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.469231 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.469940 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: external-net
May 20 16:08:34.470415 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: extra_dhcp_opt.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.472138 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.472737 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: extra_dhcp_opt
May 20 16:08:34.473095 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: extraroute.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.474073 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.474806 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: extraroute
May 20 16:08:34.475251 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: extraroute_atomic.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.476476 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.477033 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: extraroute-atomic
May 20 16:08:34.477355 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: filter_validation.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.478041 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.478576 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: filter-validation
May 20 16:08:34.478898 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: fip_pf_description.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.480093 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.480600 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 20 16:08:34.480921 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: fip_port_details.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.481828 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.482328 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: fip-port-details
May 20 16:08:34.482648 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: flavors.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.484086 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.484477 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: flavors
May 20 16:08:34.484804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.487207 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.487732 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 20 16:08:34.488061 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: floatingip_pools.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.488769 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.489276 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: floatingip-pools
May 20 16:08:34.489601 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: ip_allocation.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.490641 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.491057 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension ip_allocation not supported by any of loaded plugins
May 20 16:08:34.491439 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.492348 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.492859 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: ip-substring-filtering
May 20 16:08:34.493183 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l2_adjacency.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.494129 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.494632 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension l2_adjacency not supported by any of loaded plugins
May 20 16:08:34.495033 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l3.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.496027 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.496525 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: router
May 20 16:08:34.496847 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l3_conntrack_helper.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.499210 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.499743 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 20 16:08:34.500105 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.504237 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.504765 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: ext-gw-mode
May 20 16:08:34.505091 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.506013 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.506516 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: l3-ha
May 20 16:08:34.507120 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l3_flavors.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.508053 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.508556 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: l3-flavors
May 20 16:08:34.508876 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.509837 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.510348 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: l3-port-ip-change-not-allowed
May 20 16:08:34.510664 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: l3agentscheduler.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.511789 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.512342 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: l3_agent_scheduler
May 20 16:08:34.512663 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: logging.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.514176 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.514730 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension logging not supported by any of loaded plugins
May 20 16:08:34.515027 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: metering.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.515786 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.516372 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: metering
May 20 16:08:34.516701 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.517833 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.518344 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: metering_source_and_destination_fields
May 20 16:08:34.518673 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: multiprovidernet.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.519821 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.520334 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: multi-provider
May 20 16:08:34.520650 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: netmtu.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.521556 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.522059 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: net-mtu
May 20 16:08:34.522377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: netmtu_writable.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.523433 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.523851 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: net-mtu-writable
May 20 16:08:34.524211 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: network_availability_zone.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.524831 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.525336 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: network_availability_zone
May 20 16:08:34.525654 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: network_ip_availability.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.526755 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.527288 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: network-ip-availability
May 20 16:08:34.527611 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: network_segment_range.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.528430 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.528930 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension network-segment-range not supported by any of loaded plugins
May 20 16:08:34.529249 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: pagination.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.530319 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.530671 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: pagination
May 20 16:08:34.530873 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: port_device_profile.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.531767 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.532272 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: port-device-profile
May 20 16:08:34.532591 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.534123 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.534660 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: port-mac-address-regenerate
May 20 16:08:34.534976 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.542825 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.543374 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: port-numa-affinity-policy
May 20 16:08:34.543697 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: port_resource_request.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.544602 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.545106 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension port-resource-request not supported by any of loaded plugins
May 20 16:08:34.545427 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: portbindings.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.546350 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.546890 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: binding
May 20 16:08:34.547293 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: portbindings_extended.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.548590 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.549672 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: binding-extended
May 20 16:08:34.549996 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: portsecurity.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.550890 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.551435 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: port-security
May 20 16:08:34.551757 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: project_id.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.552762 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.553042 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: project-id
May 20 16:08:34.553360 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: providernet.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.554271 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.554791 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: provider
May 20 16:08:34.555111 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.558747 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.559303 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos not supported by any of loaded plugins
May 20 16:08:34.559633 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.560884 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.561435 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 20 16:08:34.561816 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.562730 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.563265 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 20 16:08:34.563591 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_default.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.564491 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.565022 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-default not supported by any of loaded plugins
May 20 16:08:34.565341 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_fip.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.565986 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.566487 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-fip not supported by any of loaded plugins
May 20 16:08:34.566901 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_gateway_ip.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.573319 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.573829 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 20 16:08:34.574155 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_port_network_policy.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.575054 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.575592 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 20 16:08:34.575945 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_rule_type_details.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.576857 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.577359 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 20 16:08:34.577675 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: qos_rules_alias.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.578709 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.579264 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension qos-rules-alias not supported by any of loaded plugins
May 20 16:08:34.579607 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: quotasv2.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.580733 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.581060 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: quotas
May 20 16:08:34.581378 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: quotasv2_detail.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.583050 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.583409 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: quota_details
May 20 16:08:34.583745 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: rbac.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.584822 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.585353 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: rbac-policies
May 20 16:08:34.585679 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: rbac_address_group.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.586640 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.587137 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: rbac-address-group
May 20 16:08:34.587482 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: rbac_address_scope.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.588390 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.588905 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: rbac-address-scope
May 20 16:08:34.589311 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: rbac_security_groups.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.590159 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.590670 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: rbac-security-groups
May 20 16:08:34.591079 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: rbac_subnetpool.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.592138 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.592509 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: rbac-subnetpool
May 20 16:08:34.592830 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: revisionifmatch.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.595150 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.595683 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: revision-if-match
May 20 16:08:34.596593 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: revisions.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.597708 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.598248 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: standard-attr-revisions
May 20 16:08:34.598570 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: router_availability_zone.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.599264 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.599779 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: router_availability_zone
May 20 16:08:34.600121 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: routerservicetype.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.601026 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.601537 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension router-service-type not supported by any of loaded plugins
May 20 16:08:34.601858 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.602759 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.603298 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: security-groups-normalized-cidr
May 20 16:08:34.603693 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: security_groups_port_filtering.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.604575 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.605086 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: port-security-groups-filtering
May 20 16:08:34.605396 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.606300 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.606807 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: security-groups-remote-address-group
May 20 16:08:34.607133 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: securitygroup.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.617647 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.618187 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: security-group
May 20 16:08:34.618519 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: segment.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.619356 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.619865 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension segment not supported by any of loaded plugins
May 20 16:08:34.620191 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.621181 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.621690 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 20 16:08:34.622011 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: servicetype.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.623121 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.623672 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: service-type
May 20 16:08:34.623995 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: sorting.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.625010 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.625341 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: sorting
May 20 16:08:34.625660 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: standard_attr_segment.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.626555 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.627095 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension standard-attr-segment not supported by any of loaded plugins
May 20 16:08:34.627436 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: standardattrdescription.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.628072 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.628579 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: standard-attr-description
May 20 16:08:34.628898 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: stateful_security_group.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.629814 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.630331 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: stateful-security-group
May 20 16:08:34.630649 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: stdattrs_common.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.631299 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 20 16:08:34.631622 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.632869 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.633391 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 20 16:08:34.633708 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: subnet_onboard.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.634754 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.635310 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: subnet_onboard
May 20 16:08:34.635656 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.636541 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.637088 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 20 16:08:34.637406 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: subnet_service_types.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.641430 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.641941 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: subnet-service-types
May 20 16:08:34.642263 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: subnetallocation.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.643402 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.643949 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: subnet_allocation
May 20 16:08:34.644272 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.644936 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.645478 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: subnetpool-prefix-ops
May 20 16:08:34.645773 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.646755 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.647290 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 20 16:08:34.647614 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: tagging.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.648725 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.649245 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: standard-attr-tag
May 20 16:08:34.649618 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: timestamp.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.650809 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.651357 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loaded extension: standard-attr-timestamp
May 20 16:08:34.651686 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: trunk.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.652756 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.653267 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension trunk not supported by any of loaded plugins
May 20 16:08:34.653590 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: trunk_details.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.654502 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.655070 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension trunk-details not supported by any of loaded plugins
May 20 16:08:34.655404 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: uplink_status_propagation.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.656315 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.656818 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 20 16:08:34.657138 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Loading extension file: vlantransparent.py {{(pid=92280) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 16:08:34.657814 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=92280) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 16:08:34.658910 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extension vlan-transparent not supported by any of loaded plugins
May 20 16:08:34.661520 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:network
May 20 16:08:34.662296 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:subnet
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:port
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service FLAVORS assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:router
May 20 16:08:34.668287 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:floatingip
May 20 16:08:34.668937 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service METERING assigned prefix: /metering {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.669703 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe713b4a7c0>> rbac-policy before_create 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.670074 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe713b4a7c0>> rbac-policy before_update 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.670422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe713b4a7c0>> rbac-policy before_delete 55550000 {{(pid=92280) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:08:34.671607 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of CountableResource for resource:rbac_policy
May 20 16:08:34.672055 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:security_group
May 20 16:08:34.672779 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:security_group_rule
May 20 16:08:34.673602 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service CORE assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.674646 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 16:08:34.675096 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] subnetpool is already registered
May 20 16:08:34.675746 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service CORE assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.676083 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 16:08:34.676405 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] subnetpool is already registered
May 20 16:08:34.680185 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.680618 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service FLAVORS assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.681209 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.681625 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.681960 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:router
May 20 16:08:34.682286 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] router is already registered
May 20 16:08:34.682882 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:floatingip
May 20 16:08:34.683228 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] floatingip is already registered
May 20 16:08:34.683862 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service METERING assigned prefix: /metering {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.684543 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of CountableResource for resource:rbac_policy
May 20 16:08:34.684868 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] rbac_policy is already registered
May 20 16:08:34.685406 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:security_group
May 20 16:08:34.685734 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] security_group is already registered
May 20 16:08:34.686318 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:security_group_rule
May 20 16:08:34.686645 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] security_group_rule is already registered
May 20 16:08:34.687363 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service CORE assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.687703 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 16:08:34.688029 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] subnetpool is already registered
May 20 16:08:34.688619 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.v2.resource_helper [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Service CORE assigned prefix:  {{(pid=92280) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 16:08:34.688950 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 16:08:34.689270 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING neutron.quota.resource_registry [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] subnetpool is already registered
May 20 16:08:34.689952 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: extensions {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.691472 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: address-groups {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.693116 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: address-scopes {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.694325 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: agents {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.695519 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: auto-allocated-topology {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.696827 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: availability_zones {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.698150 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: dhcp-networks {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.699659 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: dhcp-agents {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.701076 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: routers {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.702919 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: flavors {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.704136 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: service_profiles {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.705463 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: next_providers {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.706977 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: service_profiles {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.708452 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: floatingip-pools {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.709676 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: routers {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.711595 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: floatingips {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.712799 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: l3-routers {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.714181 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: l3-agents {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.718497 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: metering-labels {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.718497 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: metering-label-rules {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.718497 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: network-ip-availabilities {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.719508 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: bindings {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.721768 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: quotas {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.723239 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: quotas {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.724692 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: rbac-policies {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.726043 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: security-groups {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.727264 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: security-group-rules {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.728514 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: service-providers {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.729846 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: subnetpools {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.731316 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: subnetpools {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.732835 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.734516 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.736517 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.738785 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.742006 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.743880 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.745569 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.859870 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.861625 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.863486 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron.api.extensions [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Extended resource: tags {{(pid=92280) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 16:08:34.869412 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING keystonemiddleware.auth_token [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 20 16:08:34.874221 dv-cinder-689486-13-iscsi neutron-server[92280]: WARNING keystonemiddleware.auth_token [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 20 16:08:34.883098 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_concurrency.lockutils [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Acquired lock "singleton_lock" {{(pid=92280) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 20 16:08:34.883630 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_concurrency.lockutils [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Releasing lock "singleton_lock" {{(pid=92280) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 20 16:08:34.884280 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO oslo_service.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Starting 2 workers
May 20 16:08:34.888987 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Started child 92421 {{(pid=92280) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 16:08:34.893992 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Started child 92422 {{(pid=92280) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 16:08:34.894689 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:34.895691 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO neutron.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Neutron service started, listening on 0.0.0.0:9696
May 20 16:08:34.896337 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Notify callbacks [] for process, before_spawn {{(pid=92280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:34.896446 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [-] (92421) wsgi starting up on http://0.0.0.0:9696
May 20 16:08:34.898944 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO oslo_service.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Starting 1 workers
May 20 16:08:34.900501 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:34.902085 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [-] (92422) wsgi starting up on http://0.0.0.0:9696
May 20 16:08:34.904055 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Started child 92423 {{(pid=92280) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 16:08:34.904585 dv-cinder-689486-13-iscsi neutron-server[92280]: INFO oslo_service.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Starting 1 workers
May 20 16:08:34.907505 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] calling RpcWorker wait() {{(pid=92423) _wait /opt/stack/neutron/neutron/service.py:128}}
May 20 16:08:34.908075 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] returning from RpcWorker wait() {{(pid=92423) _wait /opt/stack/neutron/neutron/service.py:135}}
May 20 16:08:34.909600 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Started child 92424 {{(pid=92280) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 16:08:34.909983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:34.910414 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG neutron_lib.callbacks.manager [None req-e5dbd752-62a0-42bd-bffb-1eceaa175704 None None] Notify callbacks [] for process, after_spawn {{(pid=92280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:34.910533 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:08:34.912321 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92280) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 20 16:08:34.912542 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 20 16:08:34.912735 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 20 16:08:34.912957 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 20 16:08:34.913314 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 20 16:08:34.913483 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 20 16:08:34.913983 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.914257 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.914534 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.914799 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.915092 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.915214 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:34.915721 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.915979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.916264 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:08:34.916375 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.916693 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.916848 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.917011 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.917180 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.917439 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.917693 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.918018 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.918302 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.918551 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.918818 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.918994 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.919297 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.919560 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.919803 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.920067 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.920337 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.920844 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.921081 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.921322 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.921540 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.921811 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.922084 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.922379 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.922624 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.922839 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.923136 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.923455 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.923681 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.923928 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.924161 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.924442 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.924661 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.925169 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] host                           = dv-cinder-689486-13-iscsi {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.925394 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.925614 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.925861 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.926172 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.926362 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.926599 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.926846 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.927090 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.927368 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.927596 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.927846 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.928088 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.928341 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.928597 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.928862 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.929027 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.929380 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.929582 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.929773 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.929942 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.930119 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.930382 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.930546 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.930799 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.931041 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.931288 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.931505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.931743 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.931984 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.932252 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.932490 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.932725 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.932936 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.933207 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.933433 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.933655 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.933888 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.934152 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.934355 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.934575 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.934790 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.935021 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.935361 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.935525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.935744 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.935964 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.936250 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.936792 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.936792 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.937232 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.937232 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.937478 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.937653 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.937879 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.938379 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.938625 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.938625 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.938910 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.939102 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.939367 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.939627 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.939837 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.940049 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.940315 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.940552 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.940800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.941015 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.941227 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.941481 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:34.941897 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.942168 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.942474 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.942701 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.942935 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.943195 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.943463 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.943701 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.943951 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.944182 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.944550 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.944797 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.945099 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.945446 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.945666 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.945989 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.946541 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.946541 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.946771 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.946985 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.947245 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.948761 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.948761 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.948761 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.948761 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.64/identity {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.948761 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.949365 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.949365 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.949365 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.949807 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.949807 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.950033 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.950163 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.950398 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.950612 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.950832 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.951063 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.951306 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.951550 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.951778 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.952038 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.952387 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.952612 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.952852 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.953090 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.953326 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.953541 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.953777 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.954010 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.954306 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.954505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.954751 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.954967 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.955714 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.955939 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.956171 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.956388 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.956624 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.956844 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.957063 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.957316 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.957592 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.957813 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.958256 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.958256 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.959173 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.959173 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.959173 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.959173 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960016 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960016 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960016 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960016 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960476 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960476 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960694 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.960855 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.961216 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.961344 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.961525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.961773 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.961989 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.962204 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.962588 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.962985 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.964950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.964950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.964950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.964950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.964950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.964950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.964950 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.965765 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.965765 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.965765 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.966440 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.966440 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.966440 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.971453 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.973003 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976024 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.976804 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.977377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978144 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978144 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978144 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978144 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978144 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978144 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.64/identity {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978549 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.978639 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.979902 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.979902 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.979902 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.979902 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.979902 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.980467 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.980467 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.980467 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.980699 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.980844 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.981073 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982356 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982356 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982356 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982356 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982356 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982743 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982743 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.982903 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.983044 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.983279 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.983531 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.983748 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.984019 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.984270 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.984505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.984733 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.984984 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.985237 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.985445 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.985782 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.986009 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.986214 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.986450 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.986824 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.987270 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.987705 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.988132 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.988525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.988955 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.989399 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.989933 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.990395 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.990829 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.990949 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 54242) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:08:34.991130 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.991385 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.991620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.991869 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.992097 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.992317 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.992535 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.992755 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.993030 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.993304 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.993548 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.993763 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.994019 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.994251 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.994486 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.994700 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.994992 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.995278 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.995515 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.995755 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.996016 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.996246 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.996458 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.996696 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.997076 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.997076 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.997873 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.997873 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.997873 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.998283 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.998283 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.998567 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.998567 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.998839 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.998978 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.999127 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.999398 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.999631 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:34.999875 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.000098 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.000316 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.000783 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.000954 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.001105 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.001392 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.001624 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.001853 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.002168 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.002500 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.002714 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.002956 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005171 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005171 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005171 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005171 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005171 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005606 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [-] 10.222.0.64 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0112808
May 20 16:08:35.005702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.005702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.006063 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.006063 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.006654 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.007005 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.007270 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.007505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.007758 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.008044 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.008288 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.008524 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.008762 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.009001 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.009238 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.010316 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.010566 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.011217 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.011217 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.011408 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.011580 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.011800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.012017 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.012267 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.012484 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.012645 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 20 16:08:35.013236 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92280) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 20 16:08:35.013460 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 20 16:08:35.013704 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 20 16:08:35.013704 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 20 16:08:35.014070 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 20 16:08:35.014070 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 20 16:08:35.014305 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.014375 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.014527 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.014733 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.014878 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.015114 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.016932 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.016932 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.016932 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.016932 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.016932 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.017248 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.017248 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.017373 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.017455 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.018370 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.018370 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.018527 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.019591 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.019591 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.019591 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.019591 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.019591 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.020191 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.020377 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.020546 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.020910 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.020910 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.021060 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.021160 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.021319 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.021482 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.021641 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.021800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.022712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.022712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.022712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.022712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.022712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.022712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023354 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] host                           = dv-cinder-689486-13-iscsi {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023354 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023354 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023354 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023705 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023705 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023833 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.023929 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.024084 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.024242 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.024402 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.024567 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.024712 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.025038 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.025187 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.025344 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.025501 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.025664 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.025819 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.026000 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.026165 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.026324 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.026495 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.026695 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.026884 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.027015 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.027124 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.027298 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.027431 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.027564 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.027722 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.027880 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.028023 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.028162 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.028302 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.028647 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.028647 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.028935 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.028935 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.029201 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.029201 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.029579 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.029579 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030037 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030037 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030037 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030505 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030720 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030720 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.030912 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.031038 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.031152 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.031373 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.031528 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.031672 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.031811 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.031948 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.032105 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.032415 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.032725 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.033023 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.033185 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.034103 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.034271 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.034462 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.034624 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.034780 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.035125 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 16:08:35.035987 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.035987 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.035987 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.035987 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.035987 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.036307 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.036307 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.036445 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.036580 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.036907 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.037085 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.037247 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.037422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.037584 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.037746 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.037946 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.038111 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.038260 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.038414 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.038553 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.038806 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.038961 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.039104 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.039284 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.039429 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.64/identity {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.039570 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.039718 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.039856 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.039992 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.040126 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.040261 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.040407 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.040539 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.040700 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.040848 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.041012 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.041177 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.041345 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.041510 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.041657 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.041822 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.041983 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.042161 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.042303 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.042460 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.042620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.042781 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.042942 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.043105 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.043294 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.043470 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.043630 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.043791 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.044083 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.044176 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.044302 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.044462 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.044623 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.044784 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.045800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.045800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.045800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.045800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.045800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.045800 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.046433 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.046433 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.046433 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.046433 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.046817 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.046817 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.046817 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.047100 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.047100 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.047277 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.047412 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.047568 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.047732 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.047893 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.048053 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.048213 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.048374 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.048534 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.048827 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.049437 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.049587 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.049736 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.049901 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.050025 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.050181 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.050341 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.050895 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.050895 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.050895 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.051457 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.051457 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.051457 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.051457 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.051857 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.051857 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052058 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052058 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052252 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052353 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052484 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052646 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052807 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.052967 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.053126 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.053286 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.053446 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.053618 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.053779 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.054685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.054685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.054685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.054685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.054685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.054685 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.056620 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.057702 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.062068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.64/identity {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065383 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.065934 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066448 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.066979 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067525 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.067963 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068422 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.068941 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.069517 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.069517 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.069517 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.069517 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.069776 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.069776 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.069922 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.070858 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.070858 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.070858 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.070858 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.070858 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.070858 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.072517 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.072517 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.073677 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.074038 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.074268 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.074557 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.074557 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.074719 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.074890 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.075068 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.075264 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.075436 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.075617 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.075807 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.075937 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.076255 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.076455 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.076647 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.076749 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.076915 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.077079 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.077242 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.077409 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.077576 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.077751 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.077925 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.078082 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.078258 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.078428 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.078632 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.078763 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.078933 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.079108 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.079309 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.079473 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.079635 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081002 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081002 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081002 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081002 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081002 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081374 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081374 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081374 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.081544 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082495 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082495 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082495 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082495 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082495 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082495 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082881 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 16:08:35.082881 dv-cinder-689486-13-iscsi neutron-server[92280]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 20 16:08:35.086477 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:08:46.018760 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0489f0fa-50c1-4067-adcf-e8177e464119 None None] get_active_networks_info from dv-cinder-689486-13-iscsi {{(pid=92423) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 20 16:08:46.087578 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0489f0fa-50c1-4067-adcf-e8177e464119 None None] No non-hosted networks {{(pid=92423) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 20 16:08:46.094357 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.agentschedulers_db [None req-0489f0fa-50c1-4067-adcf-e8177e464119 None None] DHCP Agent not found on host dv-cinder-689486-13-iscsi {{(pid=92423) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 20 16:08:46.215145 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f3495918-c03c-4dc7-8532-6f513773976e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940'] for agent, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:48.468460 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940'] for agent, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:48.469097 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.469432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.469760 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.470086 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.470428 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.470710 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.491507 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.492184 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.492696 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.493194 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.493740 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.494251 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:08:48.494844 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fe712ea3b80>, 'Open vSwitch agent', 'dv-cinder-689486-13-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:08:48.500679 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fe715555730>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-689486-13-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:08:48.603042 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-473cde36-4668-40c3-bb75-7ac1edcbe00d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940'] for agent, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:48.650316 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.db.api [None req-64ef775d-9678-4ee8-bf43-934107c81b49 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agents.uniq_agents0agent_type0host'] with value(s) L3 agent-dv-cinder-689486-13-iscsi {{(pid=92423) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 20 16:08:48.650860 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_db.api [None req-64ef775d-9678-4ee8-bf43-934107c81b49 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 20 16:08:49.169538 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64ef775d-9678-4ee8-bf43-934107c81b49 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:49.600195 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940'] for agent, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:51.319072 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940'] for agent, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:51.657839 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.db.l3_hamode_db [None req-e57a59ba-769d-4b32-a093-3c2c8d6dfa6e None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 20 16:08:51.741761 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e57a59ba-769d-4b32-a093-3c2c8d6dfa6e None None] Routers set() bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:08:51.742151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e57a59ba-769d-4b32-a093-3c2c8d6dfa6e None None] Router IDs set() for agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 20 16:08:52.653771 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 54344) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:08:53.230754 dv-cinder-689486-13-iscsi neutron-server[92421]: WARNING oslo_policy.policy [None req-58c3c4e5-25dd-4575-ad8d-01a05e0f79ba admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:08:53.231507 dv-cinder-689486-13-iscsi neutron-server[92421]: WARNING oslo_policy.policy [None req-58c3c4e5-25dd-4575-ad8d-01a05e0f79ba admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:08:53.448540 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [None req-58c3c4e5-25dd-4575-ad8d-01a05e0f79ba admin admin] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:08:53.449509 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-58c3c4e5-25dd-4575-ad8d-01a05e0f79ba admin admin] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.7948446
May 20 16:08:55.785994 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54358) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:08:56.371168 dv-cinder-689486-13-iscsi neutron-server[92422]: WARNING oslo_policy.policy [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:08:56.371792 dv-cinder-689486-13-iscsi neutron-server[92422]: WARNING oslo_policy.policy [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:08:56.586262 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] Request body: {'subnetpool': {'shared': True, 'is_default': True, 'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:08:56.686268 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.policy [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92422) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 20 16:08:56.732457 dv-cinder-689486-13-iscsi neutron-server[92422]: WARNING oslo_policy.policy [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:08:56.732826 dv-cinder-689486-13-iscsi neutron-server[92422]: WARNING oslo_policy.policy [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:08:56.741418 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.quota [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fe713581910>.
May 20 16:08:56.756890 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:08:56.880525 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789405693951', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789405693322', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789405686183', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789405641971', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789405637494', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789405659817', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-968548', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-848037', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-8166797', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-8097029'] for rbac-policy, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:57.095796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:08:57.097175 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-8159ecb4-83fb-430a-8f62-b8dafe440715 admin admin] 10.222.0.64 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 1.3090765
May 20 16:08:59.731844 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54376) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:00.082604 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Request body: {'network': {'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'name': 'private', 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'admin_state_up': True}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:09:00.087663 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:09:00.091863 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Usage tracker for resource:network and tenant:0cfeb98a5c7f4b3d8359af78b3664d93 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:09:00.096382 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:09:00.102366 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:09:00.233358 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Made reservation on behalf of 0cfeb98a5c7f4b3d8359af78b3664d93 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:09:00.236437 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.256763 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.273094 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:09:00.276917 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Usage tracker for resource:security_group_rule and tenant:0cfeb98a5c7f4b3d8359af78b3664d93 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:09:00.282050 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:09:00.287682 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:09:00.430957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.541501 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.545952 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:00.568220 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] vlan segment allocate from pool success with {'vlan_id': 623, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:09:00.592744 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8789403300922', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.593358 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fe7142f43a0> segment precommit_create {{(pid=92422) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 20 16:09:00.593832 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Added segment b6c6cd04-148e-4fd1-8f18-e80e90a2e677 of type vlan for network fd132f23-5df8-438f-b379-87d79445a576
May 20 16:09:00.602768 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f71713fb-f7db-437f-8e09-bcacd521cb29,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:00.658679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.659026 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.660212 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.660212 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.660212 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.660492 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.660697 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.661019 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.661346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.661656 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.661966 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.662267 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Tracked resource versions report:
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]: pushed versions:
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]: {   'AddressGroup': {'1.2'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'ConntrackHelper': {'1.0'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Log': {'1.0'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Network': {'1.1'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Port': {'1.7'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'PortForwarding': {'1.2'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'QosPolicy': {'1.8'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'SecurityGroup': {'1.4'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'SecurityGroupRule': {'1.2'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'SubPort': {'1.0'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Subnet': {'1.1'},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Trunk': {'1.1'}}
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]: consumer versions:
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'ConntrackHelper': '1.0',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Log': '1.0',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Network': '1.1',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Port': '1.7',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'PortForwarding': '1.2',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'QosPolicy': '1.8',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'SecurityGroup': '1.4',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'SecurityGroupRule': '1.2',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'SubPort': '1.0',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Subnet': '1.1',
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Trunk': '1.1'}}
May 20 16:09:00.663625 dv-cinder-689486-13-iscsi neutron-server[92422]:  {{(pid=92422) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:09:00.712283 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:00.718492 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.825787 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.827298 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:00.827961 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:00.832693 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:00.935620 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Pushing event updated for resources: {'Network': ['ID=fd132f23-5df8-438f-b379-87d79445a576,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:00.938786 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:00.947176 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network fd132f23-5df8-438f-b379-87d79445a576 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:09:00.963141 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.2302291
May 20 16:09:03.625118 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54392) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:04.077817 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0525ba2-96d4-408d-b2ea-45f9eadcc75c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:04.079111 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-c0525ba2-96d4-408d-b2ea-45f9eadcc75c admin admin] 10.222.0.64 "GET /v2.0/networks/fd132f23-5df8-438f-b379-87d79445a576 HTTP/1.1" status: 200  len: 825 time: 0.4530354
May 20 16:09:04.105927 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3d532147-1bea-4c58-af85-07480ab82a22 admin admin] 10.222.0.64 "GET /v2.0/subnetpools/255d59db-d9d3-42cd-b77f-11fb467dddd3 HTTP/1.1" status: 200  len: 734 time: 0.0212922
May 20 16:09:04.114782 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Request body: {'subnet': {'gateway_ip': '172.20.0.1', 'ip_version': 4, 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'subnetpool_id': '255d59db-d9d3-42cd-b77f-11fb467dddd3', 'name': 'private-subnet'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:09:04.118989 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:09:04.122646 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Usage tracker for resource:subnet and tenant:0cfeb98a5c7f4b3d8359af78b3664d93 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:09:04.125576 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:09:04.132117 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:09:04.232813 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Made reservation on behalf of 0cfeb98a5c7f4b3d8359af78b3664d93 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:09:04.235210 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Notify callbacks [] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:04.797276 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:04.802529 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:04.881687 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Pushing event updated for resources: {'Subnet': ['ID=af02afe4-e2f7-40c5-a3b4-43c4a633c31e,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:04.885168 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:04.887879 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Checking segment: {'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:09:04.888248 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Network hostable DHCP agents. Network: fd132f23-5df8-438f-b379-87d79445a576, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:09:04.984993 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Network fd132f23-5df8-438f-b379-87d79445a576 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:09:05.059402 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, fd132f23-5df8-438f-b379-87d79445a576) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:09:05.064196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:05.064781 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:05.068638 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d7538f2-a0f4-493f-a233-6c2d8794bf3e None None] Network fd132f23-5df8-438f-b379-87d79445a576 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:09:05.379498 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-fd132f23-5df8-438f-b379-87d79445a576', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'fixed_ips': [{'subnet_id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:09:05.380683 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:05.434107 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 1.3230033
May 20 16:09:05.574180 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Allocated IP 172.20.0.2 (fd132f23-5df8-438f-b379-87d79445a576/af02afe4-e2f7-40c5-a3b4-43c4a633c31e/b304927e-4068-4d82-b98f-5670c0c7408f) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:09:05.806423 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:05.819919 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Transition to ACTIVE for port object b304927e-4068-4d82-b98f-5670c0c7408f will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:09:05.841467 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Transition to ACTIVE for port object b304927e-4068-4d82-b98f-5670c0c7408f will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:09:05.913239 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:05.918026 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:05.978269 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Network fd132f23-5df8-438f-b379-87d79445a576 is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:09:05.980985 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:09:05.987899 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:09:05.990005 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Pushing event updated for resources: {'Port': ['ID=b304927e-4068-4d82-b98f-5670c0c7408f,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:06.028506 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.028858 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.029182 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.029501 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.029814 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.030121 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.030426 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.030732 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.031050 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.031383 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.031688 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.031981 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Tracked resource versions report:
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]: pushed versions:
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]: {   'AddressGroup': {'1.2'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'ConntrackHelper': {'1.0'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Log': {'1.0'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Network': {'1.1'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Port': {'1.7'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'PortForwarding': {'1.2'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'QosPolicy': {'1.8'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'SecurityGroup': {'1.4'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'SecurityGroupRule': {'1.2'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'SubPort': {'1.0'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Subnet': {'1.1'},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Trunk': {'1.1'}}
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]: consumer versions:
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'ConntrackHelper': '1.0',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Log': '1.0',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Network': '1.1',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Port': '1.7',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'PortForwarding': '1.2',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'QosPolicy': '1.8',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'SecurityGroup': '1.4',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'SecurityGroupRule': '1.2',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'SubPort': '1.0',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Subnet': '1.1',
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Trunk': '1.1'}}
May 20 16:09:06.033867 dv-cinder-689486-13-iscsi neutron-server[92423]:  {{(pid=92423) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:09:06.063563 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:06.088815 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Attempting to bind port b304927e-4068-4d82-b98f-5670c0c7408f on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:09:06.089441 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Attempting to bind port b304927e-4068-4d82-b98f-5670c0c7408f by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:09:06.089601 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Attempting to bind port b304927e-4068-4d82-b98f-5670c0c7408f on network fd132f23-5df8-438f-b379-87d79445a576 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:09:06.094866 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 8, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:09:06.095321 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Checking segment: {'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:09:06.095893 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:06.096271 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Bound using segment: {'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:09:06.096749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Bound port: b304927e-4068-4d82-b98f-5670c0c7408f, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:09:06.097106 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:06.198983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] For port b304927e-4068-4d82-b98f-5670c0c7408f, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:09:06.203114 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] For port b304927e-4068-4d82-b98f-5670c0c7408f, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=b304927e-4068-4d82-b98f-5670c0c7408f,segment=NetworkSegment(b6c6cd04-148e-4fd1-8f18-e80e90a2e677),segment_id=b6c6cd04-148e-4fd1-8f18-e80e90a2e677)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:09:06.268367 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:06.272504 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:06.356836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Pushing event updated for resources: {'Port': ['ID=b304927e-4068-4d82-b98f-5670c0c7408f,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:06.359954 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:07.818944 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54402) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:08.188000 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [None req-c20b5072-4a35-4a12-acda-a0e3d0096d0f admin admin] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92422) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:09:08.189070 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-c20b5072-4a35-4a12-acda-a0e3d0096d0f admin admin] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3691270
May 20 16:09:10.546229 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54412) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:10.939297 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [None req-7d3db841-0020-4fd9-921a-9dfe71fb0e66 admin admin] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92422) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:09:10.940292 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-7d3db841-0020-4fd9-921a-9dfe71fb0e66 admin admin] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3931420
May 20 16:09:11.855450 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe1caeff-ad08-4ae4-8f1c-f303aadba687 None None] Network fd132f23-5df8-438f-b379-87d79445a576 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:09:12.021876 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-ef87e481-c2b5-4acc-9fb7-0fb3725a6f0f None None] Provisioning for port b304927e-4068-4d82-b98f-5670c0c7408f completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:09:12.300662 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device b304927e-4068-4d82-b98f-5670c0c7408f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:09:12.430643 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port b304927e-4068-4d82-b98f-5670c0c7408f completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:09:12.436267 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port b304927e-4068-4d82-b98f-5670c0c7408f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:12.436723 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:12.552934 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:12.584811 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port b304927e-4068-4d82-b98f-5670c0c7408f, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=b304927e-4068-4d82-b98f-5670c0c7408f,segment=NetworkSegment(b6c6cd04-148e-4fd1-8f18-e80e90a2e677),segment_id=b6c6cd04-148e-4fd1-8f18-e80e90a2e677)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:09:12.661328 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:12.663550 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-904950cc-0757-469c-b181-7d733bebd2f7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:12.731916 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=b304927e-4068-4d82-b98f-5670c0c7408f,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:12.735440 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:13.552876 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54428) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:13.900444 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Request body: {'router': {'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'name': 'router1', 'admin_state_up': True}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:09:13.905527 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:09:13.909878 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Usage tracker for resource:router and tenant:0cfeb98a5c7f4b3d8359af78b3664d93 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:09:13.913177 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:09:13.918927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:09:13.986983 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:13.988683 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:14.010333 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:14.188189 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:14.269972 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device b304927e-4068-4d82-b98f-5670c0c7408f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:09:14.336074 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port b304927e-4068-4d82-b98f-5670c0c7408f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:14.336442 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:14.367541 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:14.368848 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b301adcb-d206-4533-9d53-777360f2a910 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.8150003
May 20 16:09:15.867393 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-a5215142-f033-4fa8-8cc3-fbd4ce990c0e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:16.718031 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54438) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:17.081498 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [None req-626e141c-15fc-45a9-99c8-15304a82dc27 admin admin] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92422) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:09:17.082493 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-626e141c-15fc-45a9-99c8-15304a82dc27 admin admin] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3635323
May 20 16:09:18.415914 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:18.618727 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-149a4d72-8fca-48ce-9488-50ebeb62ccb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:19.406044 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54448) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:19.642171 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:19.779381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Request body: {'network': {'name': 'public', 'is_default': True, 'admin_state_up': True, 'provider:physical_network': 'physnet1', 'router:external': True, 'provider:network_type': 'flat'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:09:19.784740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:09:19.788814 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Usage tracker for resource:network and tenant:093e44938b8d42b18efaf0b805b9ebe5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:09:19.791609 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:09:19.797289 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:09:19.904578 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Made reservation on behalf of 093e44938b8d42b18efaf0b805b9ebe5 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:09:19.906883 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:19.919266 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:19.933634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:09:19.937330 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Usage tracker for resource:security_group_rule and tenant:093e44938b8d42b18efaf0b805b9ebe5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:09:19.940754 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:09:19.946402 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:09:20.027143 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:20.121648 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:20.125792 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:20.141012 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Reserving flat network on physical network physnet1 {{(pid=92422) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 20 16:09:20.164496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4806a1cb-6f83-4c7e-ad3f-1a88a6ab2ed1,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:20.167835 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:20.168893 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:20.169239 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Added segment 994c7083-9ec0-4a20-afb4-ae32a10fcc1c of type flat for network d2ac176c-a21a-4087-9111-35a566c1f2ad
May 20 16:09:20.201195 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:20.301506 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:20.303206 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:20.303798 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:20.307333 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:20.404856 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Pushing event updated for resources: {'Network': ['ID=d2ac176c-a21a-4087-9111-35a566c1f2ad,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:20.408540 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:20.415377 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network d2ac176c-a21a-4087-9111-35a566c1f2ad details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:09:20.485189 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 1.0779929
May 20 16:09:21.161657 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:22.811821 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54468) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:23.017661 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3754ee49-596d-409f-a757-a251ff7ab6fa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:23.018956 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3754ee49-596d-409f-a757-a251ff7ab6fa admin admin] 10.222.0.64 "GET /v2.0/subnets/af02afe4-e2f7-40c5-a3b4-43c4a633c31e HTTP/1.1" status: 200  len: 849 time: 0.2062087
May 20 16:09:23.158053 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f1771c16-f77a-4750-9e33-f1f80753cb74 admin admin] 10.222.0.64 "GET /v2.0/routers/44107c26-538f-4156-bab4-481bde7ef18a HTTP/1.1" status: 200  len: 704 time: 0.1333694
May 20 16:09:23.635671 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:23.855216 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Allocated IP 172.20.0.1 (fd132f23-5df8-438f-b379-87d79445a576/af02afe4-e2f7-40c5-a3b4-43c4a633c31e/fdccd70f-e333-4dd6-843c-4e5b68c59ced) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:09:24.005816 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.022144 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Transition to ACTIVE for port object fdccd70f-e333-4dd6-843c-4e5b68c59ced will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:09:24.127830 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.132701 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:24.190609 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Network fd132f23-5df8-438f-b379-87d79445a576 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:09:24.193512 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:09:24.197329 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:09:24.197847 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.333470 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Pushing event updated for resources: {'Port': ['ID=fdccd70f-e333-4dd6-843c-4e5b68c59ced,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:24.344562 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:24.520347 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.552763 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-4c3cc69e-457d-40ae-acbc-1ec55897fead None None] Provisioning for port fdccd70f-e333-4dd6-843c-4e5b68c59ced completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:09:24.557737 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-4c3cc69e-457d-40ae-acbc-1ec55897fead None None] Provisioning complete for port fdccd70f-e333-4dd6-843c-4e5b68c59ced triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:24.558110 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4c3cc69e-457d-40ae-acbc-1ec55897fead None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.611192 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-4c3cc69e-457d-40ae-acbc-1ec55897fead None None] Port fdccd70f-e333-4dd6-843c-4e5b68c59ced cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:09:24.745491 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.792179 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.793230 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:24.797313 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:24.931529 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Pushing event updated for resources: {'Port': ['ID=fdccd70f-e333-4dd6-843c-4e5b68c59ced,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:24.935316 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:24.982396 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Network fd132f23-5df8-438f-b379-87d79445a576 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:09:24.983500 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:09:25.133401 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-039b63b6-dbb1-40bc-9ad7-0628f92bdbfd None None] Provisioning complete for port fdccd70f-e333-4dd6-843c-4e5b68c59ced triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:25.133772 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-039b63b6-dbb1-40bc-9ad7-0628f92bdbfd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:25.217046 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-039b63b6-dbb1-40bc-9ad7-0628f92bdbfd None None] Port fdccd70f-e333-4dd6-843c-4e5b68c59ced cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:09:25.278809 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Router 44107c26-538f-4156-bab4-481bde7ef18a is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92422) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:09:25.431113 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:09:25.440234 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] 10.222.0.64 "PUT /v2.0/routers/44107c26-538f-4156-bab4-481bde7ef18a/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.2774267
May 20 16:09:25.440888 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Sync routers for ids ['44107c26-538f-4156-bab4-481bde7ef18a'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:09:25.451483 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Routers {'44107c26-538f-4156-bab4-481bde7ef18a'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:09:25.452483 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7137fe430>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:09:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['44107c26-538f-4156-bab4-481bde7ef18a'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:25.627582 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Set router 44107c26-538f-4156-bab4-481bde7ef18a gateway port host: None {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:09:25.999490 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7137fe430>, [{'id': '44107c26-538f-4156-bab4-481bde7ef18a', 'name': 'router1', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:09:13Z', 'updated_at': '2021-05-20T16:09:24Z', 'revision_number': 2, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'gw_port_host': None, '_interfaces': [{'id': 'fdccd70f-e333-4dd6-843c-4e5b68c59ced', 'name': '', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'mac_address': 'fa:16:3e:6a:df:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:23Z', 'updated_at': '2021-05-20T16:09:24Z', 'revision_number': 2, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'subnets': [{'id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '255d59db-d9d3-42cd-b77f-11fb467dddd3'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:26.004379 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Checking router: 44107c26-538f-4156-bab4-481bde7ef18a for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:09:26.004772 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Updating router 44107c26-538f-4156-bab4-481bde7ef18a port fdccd70f-e333-4dd6-843c-4e5b68c59ced binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:09:26.056062 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:26.437797 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:26.453268 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Transition to ACTIVE for port object fdccd70f-e333-4dd6-843c-4e5b68c59ced will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:09:26.538810 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:26.544150 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:26.737127 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Pushing event updated for resources: {'Port': ['ID=fdccd70f-e333-4dd6-843c-4e5b68c59ced,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:26.752570 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.752911 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.753232 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.753544 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.753862 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.754161 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.754462 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.754763 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.755083 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.755662 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.755961 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.756256 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Tracked resource versions report:
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]: pushed versions:
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]: {   'AddressGroup': {'1.2'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'ConntrackHelper': {'1.0'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Log': {'1.0'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Network': {'1.1'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Port': {'1.7'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'PortForwarding': {'1.2'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'QosPolicy': {'1.8'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'SecurityGroup': {'1.4'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'SecurityGroupRule': {'1.2'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'SubPort': {'1.0'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Subnet': {'1.1'},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Trunk': {'1.1'}}
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]: consumer versions:
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'ConntrackHelper': '1.0',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Log': '1.0',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Network': '1.1',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Port': '1.7',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'PortForwarding': '1.2',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'QosPolicy': '1.8',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'SecurityGroup': '1.4',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'SecurityGroupRule': '1.2',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'SubPort': '1.0',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Subnet': '1.1',
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Trunk': '1.1'}}
May 20 16:09:26.757737 dv-cinder-689486-13-iscsi neutron-server[92424]:  {{(pid=92424) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:09:26.769103 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:26.775926 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Attempting to bind port fdccd70f-e333-4dd6-843c-4e5b68c59ced on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:09:26.776302 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Attempting to bind port fdccd70f-e333-4dd6-843c-4e5b68c59ced by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:09:26.776745 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Attempting to bind port fdccd70f-e333-4dd6-843c-4e5b68c59ced on network fd132f23-5df8-438f-b379-87d79445a576 {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:09:26.781924 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 9, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:09:26.782805 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Checking segment: {'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:09:26.783340 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:26.783715 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Bound using segment: {'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:09:26.784183 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Bound port: fdccd70f-e333-4dd6-843c-4e5b68c59ced, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6c6cd04-148e-4fd1-8f18-e80e90a2e677', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:09:26.784543 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:26.871122 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] For port fdccd70f-e333-4dd6-843c-4e5b68c59ced, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:09:26.875143 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] For port fdccd70f-e333-4dd6-843c-4e5b68c59ced, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=fdccd70f-e333-4dd6-843c-4e5b68c59ced,segment=NetworkSegment(b6c6cd04-148e-4fd1-8f18-e80e90a2e677),segment_id=b6c6cd04-148e-4fd1-8f18-e80e90a2e677)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:09:26.958722 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:26.962730 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:27.048524 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Pushing event updated for resources: {'Port': ['ID=fdccd70f-e333-4dd6-843c-4e5b68c59ced,revision_number=4']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:27.052287 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:27.054013 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Routers {'44107c26-538f-4156-bab4-481bde7ef18a'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:09:27.054655 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7137fe430>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:09:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['44107c26-538f-4156-bab4-481bde7ef18a'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:27.237500 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] Set router 44107c26-538f-4156-bab4-481bde7ef18a gateway port host: None {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:09:27.562896 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7137fe430>, [{'id': '44107c26-538f-4156-bab4-481bde7ef18a', 'name': 'router1', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:09:13Z', 'updated_at': '2021-05-20T16:09:24Z', 'revision_number': 2, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'gw_port_host': None, '_interfaces': [{'id': 'fdccd70f-e333-4dd6-843c-4e5b68c59ced', 'name': '', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'mac_address': 'fa:16:3e:6a:df:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:23Z', 'updated_at': '2021-05-20T16:09:26Z', 'revision_number': 4, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'subnets': [{'id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '255d59db-d9d3-42cd-b77f-11fb467dddd3'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:27.567661 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48a7f96e-b46b-4a61-97f3-a210b195ac48 None None] The sync data for ids ['44107c26-538f-4156-bab4-481bde7ef18a'] in dv-cinder-689486-13-iscsi is: [{'id': '44107c26-538f-4156-bab4-481bde7ef18a', 'name': 'router1', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:09:13Z', 'updated_at': '2021-05-20T16:09:24Z', 'revision_number': 2, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'gw_port_host': None, '_interfaces': [{'id': 'fdccd70f-e333-4dd6-843c-4e5b68c59ced', 'name': '', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'mac_address': 'fa:16:3e:6a:df:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:23Z', 'updated_at': '2021-05-20T16:09:26Z', 'revision_number': 4, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'subnets': [{'id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '255d59db-d9d3-42cd-b77f-11fb467dddd3'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:09:27.580854 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54490) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:27.731416 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a93fe5c-ed83-42b3-8a09-ca6ab5d5b918 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:27.731978 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4a93fe5c-ed83-42b3-8a09-ca6ab5d5b918 admin admin] Synchronizing usage tracker for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:network {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:09:27.809945 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4a93fe5c-ed83-42b3-8a09-ca6ab5d5b918 admin admin] Unset dirty status for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:network {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:09:27.811148 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4a93fe5c-ed83-42b3-8a09-ca6ab5d5b918 admin admin] 10.222.0.64 "GET /v2.0/networks/d2ac176c-a21a-4087-9111-35a566c1f2ad HTTP/1.1" status: 200  len: 842 time: 0.2287667
May 20 16:09:27.820602 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'public-subnet', 'gateway_ip': '172.27.0.1', 'cidr': '172.27.0.0/24', 'enable_dhcp': False, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:09:27.825986 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:09:27.829852 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Usage tracker for resource:subnet and tenant:093e44938b8d42b18efaf0b805b9ebe5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:09:27.832699 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:09:27.838921 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:09:27.910469 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Made reservation on behalf of 093e44938b8d42b18efaf0b805b9ebe5 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:09:27.912740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:28.383313 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.objects.ports [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=92422) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 20 16:09:28.383761 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:28.388254 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3fcbe9e2-345f-4b8c-beb1-30e2a39a737c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:28.461461 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1b34b0e6-e5e1-49f9-83e1-66292003e5f5,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:28.464129 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:28.466560 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:09:28.467034 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Network hostable DHCP agents. Network: d2ac176c-a21a-4087-9111-35a566c1f2ad, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:09:28.558098 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:09:28.632499 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, d2ac176c-a21a-4087-9111-35a566c1f2ad) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:09:28.636648 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:28.637236 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:28.643749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c46921d-7ed3-4465-9746-ba0f8b67c8f1 None None] Network d2ac176c-a21a-4087-9111-35a566c1f2ad requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:09:28.724867 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0e87b0c0-b2d8-41c9-8d19-1944aceedeb3 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.9077775
May 20 16:09:28.846530 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a951987a-f73c-4130-a8b8-6ce71af70158 None None] Network d2ac176c-a21a-4087-9111-35a566c1f2ad requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:09:30.310225 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device fdccd70f-e333-4dd6-843c-4e5b68c59ced up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:09:30.475567 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port fdccd70f-e333-4dd6-843c-4e5b68c59ced completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:09:30.480843 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port fdccd70f-e333-4dd6-843c-4e5b68c59ced triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:30.481214 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:30.602954 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:30.636364 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port fdccd70f-e333-4dd6-843c-4e5b68c59ced, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=fdccd70f-e333-4dd6-843c-4e5b68c59ced,segment=NetworkSegment(b6c6cd04-148e-4fd1-8f18-e80e90a2e677),segment_id=b6c6cd04-148e-4fd1-8f18-e80e90a2e677)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:09:30.730153 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:30.734422 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:30.804966 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=fdccd70f-e333-4dd6-843c-4e5b68c59ced,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:30.808325 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:30.968092 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:09:30.972318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54504) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:31.168086 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-75e1288a-d5e5-458c-ac2c-26dc221769a4 admin admin] 10.222.0.64 "GET /v2.0/routers/44107c26-538f-4156-bab4-481bde7ef18a HTTP/1.1" status: 200  len: 710 time: 0.1944942
May 20 16:09:31.297201 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32e0a1dc-34e9-479f-bc67-bd33c6ffbddc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:09:31.299080 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-32e0a1dc-34e9-479f-bc67-bd33c6ffbddc admin admin] 10.222.0.64 "GET /v2.0/networks/d2ac176c-a21a-4087-9111-35a566c1f2ad HTTP/1.1" status: 200  len: 886 time: 0.1254582
May 20 16:09:31.308059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:09:31.789349 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:32.193347 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:32.250497 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:32.282811 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device fdccd70f-e333-4dd6-843c-4e5b68c59ced up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:09:32.348937 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port fdccd70f-e333-4dd6-843c-4e5b68c59ced triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:32.349305 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:32.383980 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Allocated IP 172.27.0.250 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/c60c35c9-f35c-4cd6-9797-953134a7a24f) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:09:32.527395 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:32.626831 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:32.630849 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:32.690190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:09:32.692917 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:09:32.695430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:09:32.809198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Pushing event updated for resources: {'Port': ['ID=c60c35c9-f35c-4cd6-9797-953134a7a24f,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:32.812097 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:33.200132 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:33.537657 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:33.540906 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-8306427', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-8306349', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-8333051'] for router, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:33.713566 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Router 44107c26-538f-4156-bab4-481bde7ef18a has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:09:33.887027 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:09:33.896706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:33.897285 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Sync routers for ids ['44107c26-538f-4156-bab4-481bde7ef18a'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:09:33.897905 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] 10.222.0.64 "PUT /v2.0/routers/44107c26-538f-4156-bab4-481bde7ef18a HTTP/1.1" status: 200  len: 890 time: 2.5931056
May 20 16:09:33.907924 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Routers {'44107c26-538f-4156-bab4-481bde7ef18a'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:09:33.908604 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7122f7820>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:09:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['44107c26-538f-4156-bab4-481bde7ef18a'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:34.100156 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Set router 44107c26-538f-4156-bab4-481bde7ef18a gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:09:34.472119 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7122f7820>, [{'id': '44107c26-538f-4156-bab4-481bde7ef18a', 'name': 'router1', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.250'}], 'enable_snat': True}, 'gw_port_id': 'c60c35c9-f35c-4cd6-9797-953134a7a24f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:09:13Z', 'updated_at': '2021-05-20T16:09:32Z', 'revision_number': 4, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'gw_port': {'id': 'c60c35c9-f35c-4cd6-9797-953134a7a24f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:f2:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:32Z', 'updated_at': '2021-05-20T16:09:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'fdccd70f-e333-4dd6-843c-4e5b68c59ced', 'name': '', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'mac_address': 'fa:16:3e:6a:df:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:23Z', 'updated_at': '2021-05-20T16:09:30Z', 'revision_number': 5, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'subnets': [{'id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '255d59db-d9d3-42cd-b77f-11fb467dddd3'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:34.476936 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Checking router: 44107c26-538f-4156-bab4-481bde7ef18a for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:09:34.477302 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Updating router 44107c26-538f-4156-bab4-481bde7ef18a port c60c35c9-f35c-4cd6-9797-953134a7a24f binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:09:34.528982 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:34.852554 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:34.864103 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Transition to ACTIVE for port object c60c35c9-f35c-4cd6-9797-953134a7a24f will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:09:34.944351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:34.948472 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:35.025786 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Attempting to bind port c60c35c9-f35c-4cd6-9797-953134a7a24f on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:09:35.026154 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Attempting to bind port c60c35c9-f35c-4cd6-9797-953134a7a24f by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:09:35.026516 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Attempting to bind port c60c35c9-f35c-4cd6-9797-953134a7a24f on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:09:35.033600 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5dee122-2656-4673-ac44-99f52193c40f None None] Pushing event updated for resources: {'Port': ['ID=c60c35c9-f35c-4cd6-9797-953134a7a24f,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:35.036314 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-a5dee122-2656-4673-ac44-99f52193c40f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:35.037408 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 9, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:09:35.037781 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:09:35.038177 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:35.038555 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:09:35.039025 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Bound port: c60c35c9-f35c-4cd6-9797-953134a7a24f, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:09:35.039431 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:35.111576 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] For port c60c35c9-f35c-4cd6-9797-953134a7a24f, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:09:35.114466 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] For port c60c35c9-f35c-4cd6-9797-953134a7a24f, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=c60c35c9-f35c-4cd6-9797-953134a7a24f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:09:35.176269 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:35.180531 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:35.259871 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Routers {'44107c26-538f-4156-bab4-481bde7ef18a'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:09:35.260502 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7122f7820>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:09:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['44107c26-538f-4156-bab4-481bde7ef18a'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:35.317674 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5dee122-2656-4673-ac44-99f52193c40f None None] Pushing event updated for resources: {'Port': ['ID=c60c35c9-f35c-4cd6-9797-953134a7a24f,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:35.327361 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-a5dee122-2656-4673-ac44-99f52193c40f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:35.443750 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] Set router 44107c26-538f-4156-bab4-481bde7ef18a gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:09:35.768748 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7122f7820>, [{'id': '44107c26-538f-4156-bab4-481bde7ef18a', 'name': 'router1', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.250'}], 'enable_snat': True}, 'gw_port_id': 'c60c35c9-f35c-4cd6-9797-953134a7a24f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:09:13Z', 'updated_at': '2021-05-20T16:09:32Z', 'revision_number': 4, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'gw_port': {'id': 'c60c35c9-f35c-4cd6-9797-953134a7a24f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:f2:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:32Z', 'updated_at': '2021-05-20T16:09:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'fdccd70f-e333-4dd6-843c-4e5b68c59ced', 'name': '', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'mac_address': 'fa:16:3e:6a:df:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:23Z', 'updated_at': '2021-05-20T16:09:30Z', 'revision_number': 5, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'subnets': [{'id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '255d59db-d9d3-42cd-b77f-11fb467dddd3'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:09:35.772749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b927a1c-b6cb-4a3b-9c75-4388e7c714a1 None None] The sync data for ids ['44107c26-538f-4156-bab4-481bde7ef18a'] in dv-cinder-689486-13-iscsi is: [{'id': '44107c26-538f-4156-bab4-481bde7ef18a', 'name': 'router1', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.250'}], 'enable_snat': True}, 'gw_port_id': 'c60c35c9-f35c-4cd6-9797-953134a7a24f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:09:13Z', 'updated_at': '2021-05-20T16:09:32Z', 'revision_number': 4, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'gw_port': {'id': 'c60c35c9-f35c-4cd6-9797-953134a7a24f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:f2:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:32Z', 'updated_at': '2021-05-20T16:09:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'fdccd70f-e333-4dd6-843c-4e5b68c59ced', 'name': '', 'network_id': 'fd132f23-5df8-438f-b379-87d79445a576', 'tenant_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'mac_address': 'fa:16:3e:6a:df:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44107c26-538f-4156-bab4-481bde7ef18a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:09:23Z', 'updated_at': '2021-05-20T16:09:30Z', 'revision_number': 5, 'project_id': '0cfeb98a5c7f4b3d8359af78b3664d93', 'subnets': [{'id': 'af02afe4-e2f7-40c5-a3b4-43c4a633c31e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '255d59db-d9d3-42cd-b77f-11fb467dddd3'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:09:36.241599 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 54514) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:09:36.337129 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device c60c35c9-f35c-4cd6-9797-953134a7a24f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:09:36.371436 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0b3fa178-9902-4e38-8088-799bc00f8928 admin admin] 10.222.0.64 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1277230
May 20 16:09:36.492780 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port c60c35c9-f35c-4cd6-9797-953134a7a24f completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:09:36.503447 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port c60c35c9-f35c-4cd6-9797-953134a7a24f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:36.503447 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:36.623392 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:36.643938 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port c60c35c9-f35c-4cd6-9797-953134a7a24f, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=c60c35c9-f35c-4cd6-9797-953134a7a24f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:09:36.750118 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:36.752884 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-a5dee122-2656-4673-ac44-99f52193c40f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:09:36.821136 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=c60c35c9-f35c-4cd6-9797-953134a7a24f,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:09:36.824579 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:09:38.311177 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device c60c35c9-f35c-4cd6-9797-953134a7a24f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:09:38.386989 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port c60c35c9-f35c-4cd6-9797-953134a7a24f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:09:38.387868 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:45.947454 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-756865cd-ca2d-428c-a57a-99abc6310a36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:48.437990 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:48.634991 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ffaa3be8-9698-49dd-b4f4-5f7827b0495e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:49.541188 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:09:51.183409 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:07.967064 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:10:15.906643 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3721b267-1026-4188-a1c1-ec689db7c779 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:19.194082 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:19.228646 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-28c1b6f8-d2ef-4a92-9287-7be036b93882 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:19.588453 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:21.171428 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:44.966938 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:10:45.866296 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-307afd53-b3ce-4722-baa3-8b210b58c4df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:48.421696 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:48.644861 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c24d8ef7-5e61-4dc0-9863-30922a8697c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:49.562864 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:10:51.181869 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:14.048080 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55084) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:14.122655 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.pecan_wsgi.hooks.translation [None req-a1655ea2-c2fa-4a01-9e0b-2c3942a2049f admin admin] GET failed (client error): The resource could not be found.
May 20 16:11:14.124567 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a1655ea2-c2fa-4a01-9e0b-2c3942a2049f admin admin] 10.222.0.64 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0753767
May 20 16:11:14.260221 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-308de68f-95c1-4783-afee-4db88cba432c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:14.261806 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-308de68f-95c1-4783-afee-4db88cba432c admin admin] 10.222.0.64 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1330779
May 20 16:11:15.854758 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-1ddb4bc3-9132-44c3-85ab-06b3715b6473 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:16.377530 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55094) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:16.600801 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.policy [None req-e2c090a4-ee05-4390-953e-15bfebe36896 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92421) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 20 16:11:16.647828 dv-cinder-689486-13-iscsi neutron-server[92421]: WARNING oslo_policy.policy [None req-e2c090a4-ee05-4390-953e-15bfebe36896 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:11:16.648214 dv-cinder-689486-13-iscsi neutron-server[92421]: WARNING oslo_policy.policy [None req-e2c090a4-ee05-4390-953e-15bfebe36896 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 16:11:16.657052 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2c090a4-ee05-4390-953e-15bfebe36896 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:16.658803 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e2c090a4-ee05-4390-953e-15bfebe36896 admin admin] 10.222.0.64 "GET /v2.0/subnets/af02afe4-e2f7-40c5-a3b4-43c4a633c31e HTTP/1.1" status: 200  len: 849 time: 0.2803664
May 20 16:11:16.668687 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:11:16.788571 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Notify callbacks [] for subnet, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:17.060570 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8789403239873'] for subnet, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:17.067912 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:11:17.143002 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:17.143935 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:17.144958 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] 10.222.0.64 "PUT /v2.0/subnets/af02afe4-e2f7-40c5-a3b4-43c4a633c31e HTTP/1.1" status: 200  len: 868 time: 0.4805305
May 20 16:11:17.147629 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6602bafe-2f45-4a52-9f9c-358a6266c83f None None] Network fd132f23-5df8-438f-b379-87d79445a576 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:11:17.174299 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=af02afe4-e2f7-40c5-a3b4-43c4a633c31e,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:11:17.183742 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.184121 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.184407 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.184748 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.185102 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.185421 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.185774 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.186108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.186444 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.186756 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.187064 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.187394 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Tracked resource versions report:
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]: pushed versions:
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]: {   'AddressGroup': {'1.2'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'ConntrackHelper': {'1.0'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Log': {'1.0'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Network': {'1.1'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Port': {'1.7'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'PortForwarding': {'1.2'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'QosPolicy': {'1.8'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'SecurityGroup': {'1.4'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'SecurityGroupRule': {'1.2'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'SubPort': {'1.0'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Subnet': {'1.1'},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Trunk': {'1.1'}}
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]: consumer versions:
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'ConntrackHelper': '1.0',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Log': '1.0',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Network': '1.1',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Port': '1.7',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'PortForwarding': '1.2',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'QosPolicy': '1.8',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'SecurityGroup': '1.4',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'SecurityGroupRule': '1.2',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'SubPort': '1.0',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Subnet': '1.1',
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Trunk': '1.1'}}
May 20 16:11:17.188802 dv-cinder-689486-13-iscsi neutron-server[92421]:  {{(pid=92421) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:11:17.193057 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:11:17.670742 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-5a4bbf8f-265c-49f1-a74e-eb5aa467c30d None None] Provisioning complete for port fdccd70f-e333-4dd6-843c-4e5b68c59ced triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:11:17.671103 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5a4bbf8f-265c-49f1-a74e-eb5aa467c30d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:17.799633 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-5a4bbf8f-265c-49f1-a74e-eb5aa467c30d None None] Provisioning complete for port b304927e-4068-4d82-b98f-5670c0c7408f triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:11:17.800008 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5a4bbf8f-265c-49f1-a74e-eb5aa467c30d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:18.431993 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:18.643519 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b172e153-e49a-4260-99c3-711cd2ae60cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:19.288811 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55110) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:19.483280 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9122efde-3973-4905-931d-f446599ee01c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:19.483647 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9122efde-3973-4905-931d-f446599ee01c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:19.485168 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-9122efde-3973-4905-931d-f446599ee01c admin admin] 10.222.0.64 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1953900
May 20 16:11:19.546815 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:21.202221 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:21.626477 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55120) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:21.795758 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39f5769e-2ac1-43cf-bb0a-fb045fa7c887 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:21.796235 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39f5769e-2ac1-43cf-bb0a-fb045fa7c887 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:21.797764 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-39f5769e-2ac1-43cf-bb0a-fb045fa7c887 admin admin] 10.222.0.64 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1700714
May 20 16:11:21.966550 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:11:23.927343 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55130) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:24.144078 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37d5425e-5a76-439e-ba72-dafc1735a4bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:24.145330 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-37d5425e-5a76-439e-ba72-dafc1735a4bc admin admin] 10.222.0.64 "GET /v2.0/networks/d2ac176c-a21a-4087-9111-35a566c1f2ad HTTP/1.1" status: 200  len: 886 time: 0.2170439
May 20 16:11:26.252401 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55140) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:26.426650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b98124d-de36-4938-9b27-8f147cb71f03 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:26.428049 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-7b98124d-de36-4938-9b27-8f147cb71f03 admin admin] 10.222.0.64 "GET /v2.0/networks/fd132f23-5df8-438f-b379-87d79445a576 HTTP/1.1" status: 200  len: 869 time: 0.1746926
May 20 16:11:28.559030 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55150) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:28.664909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8384ab89-3bf5-44b6-95e5-548094b6ee93 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:28.665374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8384ab89-3bf5-44b6-95e5-548094b6ee93 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:28.666096 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-8384ab89-3bf5-44b6-95e5-548094b6ee93 admin admin] Synchronizing usage tracker for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:subnet {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:11:28.791365 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-8384ab89-3bf5-44b6-95e5-548094b6ee93 admin admin] Unset dirty status for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:subnet {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:11:28.792666 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-8384ab89-3bf5-44b6-95e5-548094b6ee93 admin admin] 10.222.0.64 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.2326190
May 20 16:11:30.877005 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55160) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:30.984326 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99d2379c-1463-479d-866d-f44782b21e60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:30.984798 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99d2379c-1463-479d-866d-f44782b21e60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:30.986390 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-99d2379c-1463-479d-866d-f44782b21e60 admin admin] 10.222.0.64 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1084130
May 20 16:11:33.089050 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55170) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:33.193105 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1fcaae2-04da-4fa5-989c-51759d3a0ccb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:33.194428 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-f1fcaae2-04da-4fa5-989c-51759d3a0ccb admin admin] 10.222.0.64 "GET /v2.0/subnets/1b34b0e6-e5e1-49f9-83e1-66292003e5f5 HTTP/1.1" status: 200  len: 816 time: 0.1041260
May 20 16:11:35.313587 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55180) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:35.424324 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-942d4a3a-c8e2-464b-b96a-524b15955c11 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:11:35.425581 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-942d4a3a-c8e2-464b-b96a-524b15955c11 admin admin] 10.222.0.64 "GET /v2.0/subnets/af02afe4-e2f7-40c5-a3b4-43c4a633c31e HTTP/1.1" status: 200  len: 868 time: 0.1110516
May 20 16:11:45.847963 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-a1a8740c-d79f-4e17-b948-5ade96e5390b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:48.407867 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:48.641887 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d51b099c-f568-45f9-8a67-9a36d865d541 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:49.596432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:51.190594 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:11:58.332953 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55224) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:11:58.382153 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [None req-5b614090-7fb5-411e-aabf-bef5d40fed55 admin admin] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92422) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:11:58.383119 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5b614090-7fb5-411e-aabf-bef5d40fed55 admin admin] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0492439
May 20 16:11:58.966006 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:12:00.564499 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55234) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:12:00.631963 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.pecan_wsgi.hooks.translation [None req-c0f84aca-9ccc-4813-8541-a6212831f02e admin admin] GET failed (client error): The resource could not be found.
May 20 16:12:00.633206 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-c0f84aca-9ccc-4813-8541-a6212831f02e admin admin] 10.222.0.64 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0677845
May 20 16:12:00.756141 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66bda218-8dc6-496d-8c44-33523223266f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:12:00.757589 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-66bda218-8dc6-496d-8c44-33523223266f admin admin] 10.222.0.64 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1204779
May 20 16:12:02.894558 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55244) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:12:02.942931 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:12:02.947457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:12:02.957216 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:12:03.052862 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Made reservation on behalf of 093e44938b8d42b18efaf0b805b9ebe5 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:12:03.055174 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:03.144765 dv-cinder-689486-13-iscsi neutron-server[92422]: WARNING neutron.services.revisions.revision_plugin [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7fe71263e250] {project_id='093e44938b8d42b18efaf0b805b9ebe5', id='1fabfabd-0fc4-470d-80c1-275e5d6d6f9d', target_tenant='*', action='access_as_shared', object_id='81e1d97d-8a33-4044-83b4-907740b1aca7'}> to bump revision.
May 20 16:12:03.155748 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] vlan segment allocate from pool success with {'vlan_id': 619, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:12:03.164046 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:03.164385 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Added segment b6d80164-e565-4ad3-a39d-687326b982c6 of type vlan for network 81e1d97d-8a33-4044-83b4-907740b1aca7
May 20 16:12:03.190807 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:03.281741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:03.283075 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:12:03.283776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:03.289019 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:12:03.382124 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Pushing event updated for resources: {'Network': ['ID=81e1d97d-8a33-4044-83b4-907740b1aca7,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:12:03.389523 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.389864 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.390198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.390524 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.390846 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.391167 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.391505 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.391829 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.392167 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.392485 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.392796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.393105 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:03.396640 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:12:03.404175 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 81e1d97d-8a33-4044-83b4-907740b1aca7 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:12:03.465750 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.5699608
May 20 16:12:05.576351 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55254) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:12:05.642455 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.pecan_wsgi.hooks.translation [None req-ff54317d-764d-45ab-8588-83bdea731dd8 admin admin] GET failed (client error): The resource could not be found.
May 20 16:12:05.642965 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-ff54317d-764d-45ab-8588-83bdea731dd8 admin admin] Synchronizing usage tracker for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:network {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:12:05.732683 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-ff54317d-764d-45ab-8588-83bdea731dd8 admin admin] Unset dirty status for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:network {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:12:05.733839 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ff54317d-764d-45ab-8588-83bdea731dd8 admin admin] 10.222.0.64 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.1565480
May 20 16:12:05.838708 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b243f79-cced-4b86-9fcd-28f89839c00d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:12:05.840702 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-7b243f79-cced-4b86-9fcd-28f89839c00d admin admin] 10.222.0.64 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1019747
May 20 16:12:05.850092 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'ip_version': 4, 'description': 'shared-subnet', 'name': 'shared-subnet', 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:12:05.854400 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:12:05.864426 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:12:05.927342 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Made reservation on behalf of 093e44938b8d42b18efaf0b805b9ebe5 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:12:05.929654 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:06.387813 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:06.391801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:12:06.462448 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c1eae10b-39b6-4f33-8f12-5a3e9efa6216,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:12:06.466350 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:12:06.473580 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Checking segment: {'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:12:06.473924 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Network hostable DHCP agents. Network: 81e1d97d-8a33-4044-83b4-907740b1aca7, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:12:06.567752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Network 81e1d97d-8a33-4044-83b4-907740b1aca7 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:12:06.653437 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 81e1d97d-8a33-4044-83b4-907740b1aca7) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:12:06.657593 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:12:06.658184 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:06.663854 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ea5db65-9ead-4594-9487-185818f471c2 None None] Network 81e1d97d-8a33-4044-83b4-907740b1aca7 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:12:06.791118 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-50e01c23-17e8-42cf-9ab1-d5cdda896e06 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.9442880
May 20 16:12:06.893335 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-81e1d97d-8a33-4044-83b4-907740b1aca7', 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7', 'tenant_id': '093e44938b8d42b18efaf0b805b9ebe5', 'fixed_ips': [{'subnet_id': 'c1eae10b-39b6-4f33-8f12-5a3e9efa6216'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:12:06.894420 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:07.056519 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Allocated IP 192.168.233.2 (81e1d97d-8a33-4044-83b4-907740b1aca7/c1eae10b-39b6-4f33-8f12-5a3e9efa6216/06b866bd-666f-479c-9a58-2c83e064626a) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:12:07.314196 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:07.324516 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Transition to ACTIVE for port object 06b866bd-666f-479c-9a58-2c83e064626a will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:12:07.360794 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Transition to ACTIVE for port object 06b866bd-666f-479c-9a58-2c83e064626a will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:12:07.430918 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:07.435613 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:12:07.498203 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Network 81e1d97d-8a33-4044-83b4-907740b1aca7 is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:12:07.501238 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:12:07.504829 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:12:07.512536 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Pushing event updated for resources: {'Port': ['ID=06b866bd-666f-479c-9a58-2c83e064626a,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:12:07.550477 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.550827 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.551161 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.551529 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.551836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.552158 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.552474 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.552784 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.553118 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.553433 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.553745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.554071 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:12:07.583357 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:12:07.608596 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Attempting to bind port 06b866bd-666f-479c-9a58-2c83e064626a on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:12:07.608955 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Attempting to bind port 06b866bd-666f-479c-9a58-2c83e064626a by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:12:07.609311 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Attempting to bind port 06b866bd-666f-479c-9a58-2c83e064626a on network 81e1d97d-8a33-4044-83b4-907740b1aca7 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:12:07.614479 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 11, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:12:07.614846 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Checking segment: {'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:12:07.615261 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:07.615647 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Bound using segment: {'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:12:07.616112 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Bound port: 06b866bd-666f-479c-9a58-2c83e064626a, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:12:07.616476 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:07.703334 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] For port 06b866bd-666f-479c-9a58-2c83e064626a, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:12:07.706395 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] For port 06b866bd-666f-479c-9a58-2c83e064626a, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=06b866bd-666f-479c-9a58-2c83e064626a,segment=NetworkSegment(b6d80164-e565-4ad3-a39d-687326b982c6),segment_id=b6d80164-e565-4ad3-a39d-687326b982c6)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:12:07.779375 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:07.783436 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:12:07.859512 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Pushing event updated for resources: {'Port': ['ID=06b866bd-666f-479c-9a58-2c83e064626a,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:12:07.862520 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:12:08.446525 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 06b866bd-666f-479c-9a58-2c83e064626a up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:12:08.586893 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 06b866bd-666f-479c-9a58-2c83e064626a completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:12:08.706717 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a09e3fc3-d5c4-46b2-91ee-260cb40f6bf3 None None] Network 81e1d97d-8a33-4044-83b4-907740b1aca7 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:12:08.873281 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Provisioning for port 06b866bd-666f-479c-9a58-2c83e064626a completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:12:08.887985 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Provisioning complete for port 06b866bd-666f-479c-9a58-2c83e064626a triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:12:08.888351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:09.064745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:09.102663 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] For port 06b866bd-666f-479c-9a58-2c83e064626a, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=06b866bd-666f-479c-9a58-2c83e064626a,segment=NetworkSegment(b6d80164-e565-4ad3-a39d-687326b982c6),segment_id=b6d80164-e565-4ad3-a39d-687326b982c6)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:12:09.150489 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:09.155143 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:12:09.287512 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Pushing event updated for resources: {'Port': ['ID=06b866bd-666f-479c-9a58-2c83e064626a,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:12:09.291950 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:12:09.299027 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-f9b8d17d-0d7e-45f9-863f-c305dc2c237c None None] Provisioning complete for port 06b866bd-666f-479c-9a58-2c83e064626a triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:12:09.299443 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f9b8d17d-0d7e-45f9-863f-c305dc2c237c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:10.403336 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 06b866bd-666f-479c-9a58-2c83e064626a up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:12:10.473002 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 06b866bd-666f-479c-9a58-2c83e064626a triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:12:10.473374 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:15.875316 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f133dedd-e89e-4ad3-97dc-e95feb67c958 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:18.389862 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:18.589577 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b5642a23-b6f7-4fb0-8be5-4f17f3ee6c83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:19.544301 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:21.184383 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:35.965026 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:12:45.875266 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-fcf426a4-732a-4a40-9588-dae25bd2c5f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:48.418334 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:48.612491 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3b3d360d-a93b-4018-a474-d678a8349c8f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:49.543703 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:12:51.215548 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:12.965119 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:13:15.863303 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d741cfd0-1631-4301-bfb6-b381b034eb8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:18.406500 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:18.599521 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d0cbbfbe-9d29-43fb-831f-83a882616566 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:19.560091 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:21.217773 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:22.910442 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55304) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:13:22.916860 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [None req-f406eecb-91d6-4663-b8b6-f3dd7e0dcfca tempest-verify_tempest_config-522808158 tempest-verify_tempest_config-522808158-project] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92422) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:13:22.917864 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f406eecb-91d6-4663-b8b6-f3dd7e0dcfca tempest-verify_tempest_config-522808158 tempest-verify_tempest_config-522808158-project] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0064542
May 20 16:13:23.467143 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55322) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:13:23.585272 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:23.600372 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:13:23.605135 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Usage tracker for resource:security_group_rule and tenant:fd60a37e4f9d486b8a5d007f06e87b9d is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:13:23.608048 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:13:23.613644 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:13:23.701076 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:23.766263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:23.774164 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-43d77932-14b7-4233-a391-974f7f8ba871 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:13:23.815552 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Synchronizing usage tracker for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:security_group {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:13:23.818994 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=953d8023-bf3d-46e7-8854-e7da279c2f0c,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:13:23.829665 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.830023 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.830361 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.830687 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.831009 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.831371 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.831694 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.832035 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.832378 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.832693 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.833005 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.833316 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:23.837875 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:13:23.954944 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Unset dirty status for tenant:093e44938b8d42b18efaf0b805b9ebe5 on resource:security_group {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:13:23.958009 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=fd60a37e4f9d486b8a5d007f06e87b9d&name=default HTTP/1.1" status: 200  len: 2975 time: 0.4898160
May 20 16:13:23.960931 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55328) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:13:24.035034 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:24.060935 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:24.235641 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:24.241838 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:13:24.253339 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=953d8023-bf3d-46e7-8854-e7da279c2f0c,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:13:24.264620 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.264984 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.265338 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.265698 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.266016 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.266353 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.266716 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.266986 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.267332 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.267642 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.268014 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.268322 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:13:24.272439 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:13:24.273289 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:24.277366 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/953d8023-bf3d-46e7-8854-e7da279c2f0c HTTP/1.1" status: 204  len: 168 time: 0.3153603
May 20 16:13:45.862777 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7de4f981-c3eb-4ad2-bc07-d56fbafdc7dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:48.404148 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:48.598275 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-54e06e7a-d708-4746-8cf0-35d797dd9578 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:49.564030 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:13:49.964485 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:13:51.215384 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:15.862380 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4ed13bc7-7c99-4e61-97bb-174b37cf93eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:18.410974 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:18.602651 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-827423c2-e51f-4911-8dd6-81759c125567 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:19.568476 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:21.200383 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:26.963793 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 5 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:14:45.856310 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b5cbe4c1-0ddd-4b91-a36f-cc96dbb8a24e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:48.430412 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:48.659399 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-a8e626ec-5cf6-4eee-a18f-566ac7d97cd8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:49.602019 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:51.310419 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:14:58.521912 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940'] for agent, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:02.074483 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55380) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:15:02.186381 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1e312124-5728-4616-9687-83bc860db14e admin admin] 10.222.0.64 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4309 time: 0.1108077
May 20 16:15:03.963119 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:15:04.316608 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55390) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:15:04.370770 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d7a6dbea-297c-4bfc-971e-0a4d795d281e admin admin] 10.222.0.64 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4309 time: 0.0530987
May 20 16:15:15.892379 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-17020ad0-218c-4c87-948b-8b01e2a7c3ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:18.398460 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:18.606464 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2b33ce69-a902-4296-808d-ffcf57f94c54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:19.566393 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:21.236284 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:28.503390 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:40.962376 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:15:45.857270 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-be78b3cd-6b98-4f18-b652-2afe0979b5bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:48.421409 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:48.598141 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5879205d-ab48-480a-8799-19dab04bdfcd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:49.580992 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:51.211817 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:15:58.478246 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:15.868118 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cc4710fb-f902-4621-90a7-90fa7afc4a33 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:17.962518 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:16:18.393413 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:18.587890 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-847deae5-62a0-4d7a-8237-074578cbb6a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:19.582127 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:21.197877 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:28.485636 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:32.991963 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55610) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:33.127509 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55618) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:33.242871 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55630) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:33.334243 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-network', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:33.339431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:33.353343 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Usage tracker for resource:network and tenant:11c3c5cf74b64f749939ab72b3ea04ce is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:33.356578 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:33.363075 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:33.367575 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55636) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:33.412131 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1530945155-network', 'tenant_id': '747fc4332771467fa24e6bc07899b54f'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:33.413290 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.quota [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fe7134dcc10>.
May 20 16:16:33.419671 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:33.423860 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Usage tracker for resource:network and tenant:747fc4332771467fa24e6bc07899b54f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:33.427348 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:33.437755 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:33.575924 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Made reservation on behalf of 11c3c5cf74b64f749939ab72b3ea04ce for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:33.579214 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.587573 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Made reservation on behalf of 747fc4332771467fa24e6bc07899b54f for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:33.590131 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.604145 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.618285 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.625355 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:33.640282 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:33.650802 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Usage tracker for resource:security_group_rule and tenant:11c3c5cf74b64f749939ab72b3ea04ce is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:33.652245 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Usage tracker for resource:security_group_rule and tenant:747fc4332771467fa24e6bc07899b54f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:33.657052 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:33.663866 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:33.672921 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:33.680208 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:33.776903 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.832527 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-network', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:33.837288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:33.838630 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.841651 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Usage tracker for resource:network and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:33.844935 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:33.851264 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:33.852402 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] vlan segment allocate from pool success with {'vlan_id': 622, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:16:33.862535 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.863129 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.863571 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Added segment e795581d-abe8-47e4-ab5f-18a44335be8d of type vlan for network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4
May 20 16:16:33.889617 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-431872236-network', 'tenant_id': '50d0b3d2f6dc41c492d29c820372735f'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:33.900361 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.914583 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:33.931449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Usage tracker for resource:network and tenant:50d0b3d2f6dc41c492d29c820372735f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:33.954404 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:33.991321 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:33.995978 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:34.045910 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] vlan segment allocate from pool success with {'vlan_id': 608, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:16:34.049576 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:34.069899 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8789403300922', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.079466 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fe7142f43a0> segment precommit_create {{(pid=92421) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 20 16:16:34.079466 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Added segment 6b15b2ba-0475-4448-8bb1-4db4352f2b43 of type vlan for network 7250e4c3-f4ff-4878-8316-65dfc0975bd3
May 20 16:16:34.084666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdc102a2-f6fe-4641-ba93-6568d053d288,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:34.110007 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Tracked resource versions report:
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: pushed versions:
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: {   'AddressGroup': {'1.2'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'ConntrackHelper': {'1.0'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Log': {'1.0'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Network': {'1.1'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Port': {'1.7'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'PortForwarding': {'1.2'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'QosPolicy': {'1.8'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'SecurityGroup': {'1.4'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'SecurityGroupRule': {'1.2'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'SubPort': {'1.0'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Subnet': {'1.1'},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     'Trunk': {'1.1'}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: consumer versions:
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     HyperV agent@hv-cinder-68948: {},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'ConntrackHelper': '1.0',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Log': '1.0',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Network': '1.1',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Port': '1.7',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'PortForwarding': '1.2',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'QosPolicy': '1.8',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'SecurityGroup': '1.4',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'SecurityGroupRule': '1.2',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'SubPort': '1.0',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Subnet': '1.1',
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:                                                       'Trunk': '1.1'}}
May 20 16:16:34.119649 dv-cinder-689486-13-iscsi neutron-server[92422]:  {{(pid=92422) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:16:34.127425 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:34.143592 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:34.154855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Made reservation on behalf of ddfbe809b7ae4afba7cc3bc0c9fc5984 for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:34.154855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.176283 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.177679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:34.178250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.183236 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:34.192846 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.262864 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.280923 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c7a57052-8dc4-4a60-80b0-5e9b0480dff5,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:34.291062 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:34.295539 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Usage tracker for resource:security_group_rule and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:34.299329 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:34.309934 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.310100 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Pushing event updated for resources: {'Network': ['ID=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:34.310673 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.311256 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.311878 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.312958 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.313513 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.314057 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.314623 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.315199 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.315758 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.316145 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.316660 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Tracked resource versions report:
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]: pushed versions:
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]: {   'AddressGroup': {'1.2'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'ConntrackHelper': {'1.0'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Log': {'1.0'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Network': {'1.1'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Port': {'1.7'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'PortForwarding': {'1.2'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'QosPolicy': {'1.8'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'SecurityGroup': {'1.4'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'SecurityGroupRule': {'1.2'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'SubPort': {'1.0'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Subnet': {'1.1'},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     'Trunk': {'1.1'}}
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]: consumer versions:
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     HyperV agent@hv-cinder-68948: {},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'ConntrackHelper': '1.0',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Log': '1.0',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Network': '1.1',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Port': '1.7',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'PortForwarding': '1.2',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'QosPolicy': '1.8',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'SecurityGroup': '1.4',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'SecurityGroupRule': '1.2',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'SubPort': '1.0',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Subnet': '1.1',
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:                                                       'Trunk': '1.1'}}
May 20 16:16:34.318500 dv-cinder-689486-13-iscsi neutron-server[92421]:  {{(pid=92421) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:16:34.324779 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:34.325013 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:16:34.350228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:34.352717 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:34.360159 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.362572 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Made reservation on behalf of 50d0b3d2f6dc41c492d29c820372735f for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:34.368474 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.387732 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:34.388322 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.393395 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.394730 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 1.4016113
May 20 16:16:34.397642 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55666) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:34.404047 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Request body: {'subnet': {'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-subnet', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:34.410328 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:34.414415 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:34.419006 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Usage tracker for resource:subnet and tenant:11c3c5cf74b64f749939ab72b3ea04ce is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:34.429582 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:34.439567 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:34.507526 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:34.521968 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Usage tracker for resource:security_group_rule and tenant:50d0b3d2f6dc41c492d29c820372735f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:34.528959 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:34.541859 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Made reservation on behalf of 11c3c5cf74b64f749939ab72b3ea04ce for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:34.544264 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.585859 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:34.602615 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Pushing event updated for resources: {'Network': ['ID=7250e4c3-f4ff-4878-8316-65dfc0975bd3,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:34.606048 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:34.618317 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:16:34.686572 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.5579309
May 20 16:16:34.692929 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55676) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:34.706642 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Request body: {'subnet': {'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1530945155-subnet', 'tenant_id': '747fc4332771467fa24e6bc07899b54f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:34.719088 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:34.732119 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.736379 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Usage tracker for resource:subnet and tenant:747fc4332771467fa24e6bc07899b54f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:34.740252 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:34.755497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:34.775328 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.778374 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.782338 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-6139a3f4-d578-4ebd-925c-410adb1d33e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:34.805186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] vlan segment allocate from pool success with {'vlan_id': 609, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:16:34.827099 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=215960a6-1bf1-42c7-bd2e-19649f92faf7,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:34.830275 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:34.831630 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.831997 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Added segment c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a of type vlan for network 77fd2be7-62d4-4a17-a108-9198b949900a
May 20 16:16:34.854531 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.855301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Made reservation on behalf of 747fc4332771467fa24e6bc07899b54f for: {'subnet': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:34.857693 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.891235 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:34.898668 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:34.999226 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] vlan segment allocate from pool success with {'vlan_id': 643, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:16:35.011531 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af385028-d2f7-4719-81cf-7a02220b68f5,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:35.014616 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:35.046182 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.046526 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Added segment 6693d38d-3373-4cfe-8791-6de4025dd8b2 of type vlan for network 679d7722-330c-49b6-b5b8-e851267c2357
May 20 16:16:35.085535 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.123288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.128867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:35.129455 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.136532 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:35.142559 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.148868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:35.232871 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:35.237368 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:35.241501 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Checking segment: {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:35.241834 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Network hostable DHCP agents. Network: 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:16:35.292613 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Pushing event updated for resources: {'Network': ['ID=77fd2be7-62d4-4a17-a108-9198b949900a,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:35.298607 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:35.304723 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 77fd2be7-62d4-4a17-a108-9198b949900a details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:16:35.347605 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:16:35.349719 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.351489 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:35.352152 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.361366 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:35.433551 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:35.439032 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:35.440198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.448667 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-796efd51-821b-4c13-a34e-8ccdcc066f58 None None] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:35.487720 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 890 time: 2.2429972
May 20 16:16:35.492363 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55702) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:35.493748 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Pushing event updated for resources: {'Network': ['ID=679d7722-330c-49b6-b5b8-e851267c2357,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:35.501211 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:35.502510 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Request body: {'subnet': {'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-subnet', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:35.508003 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 679d7722-330c-49b6-b5b8-e851267c2357 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:16:35.508611 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:35.516238 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Usage tracker for resource:subnet and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:35.516876 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:35.523108 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:35.564926 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 1.1628582
May 20 16:16:35.565250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55708) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:35.570495 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:35.581396 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:35.592844 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Usage tracker for resource:router and tenant:11c3c5cf74b64f749939ab72b3ea04ce is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:35.597222 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:35.615315 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:35.638357 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Made reservation on behalf of ddfbe809b7ae4afba7cc3bc0c9fc5984 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:35.643388 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.655102 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 2.2861340
May 20 16:16:35.659775 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55718) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:35.668232 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Request body: {'subnet': {'network_id': '679d7722-330c-49b6-b5b8-e851267c2357', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-431872236-subnet', 'tenant_id': '50d0b3d2f6dc41c492d29c820372735f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:35.674137 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:35.678341 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Usage tracker for resource:subnet and tenant:50d0b3d2f6dc41c492d29c820372735f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:35.682371 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:35.688995 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:35.789442 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.792482 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.849051 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcc76525-6988-4900-adf7-50295824e109 None None] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:35.850318 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Made reservation on behalf of 50d0b3d2f6dc41c492d29c820372735f for: {'subnet': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:35.852894 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:35.870415 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:36.129299 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:36.145088 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:36.255759 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Pushing event updated for resources: {'Subnet': ['ID=924a520e-53e5-4777-beb9-f9e6d0bd0dff,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:36.265294 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:36.304503 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:36.328699 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Checking segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:36.329283 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Network hostable DHCP agents. Network: 7250e4c3-f4ff-4878-8316-65dfc0975bd3, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92421) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:16:36.450940 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92421) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:16:36.584063 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 7250e4c3-f4ff-4878-8316-65dfc0975bd3) {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:36.590114 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:36.590114 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:36.590726 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:36.595927 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f494f1ff-ca79-4e39-87db-5a989933a24d None None] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:36.597487 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:36.714055 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:36.725628 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 2.0205796
May 20 16:16:36.725628 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:36.792127 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Pushing event updated for resources: {'Subnet': ['ID=62bb207d-d1f6-4694-870b-d608e6900fa3,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:36.796145 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:36.805390 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Checking segment: {'id': '6693d38d-3373-4cfe-8791-6de4025dd8b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '679d7722-330c-49b6-b5b8-e851267c2357'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:36.805742 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Network hostable DHCP agents. Network: 679d7722-330c-49b6-b5b8-e851267c2357, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92421) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:16:36.834328 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6603d6ca-d9c5-43ea-9460-887404877844 None None] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:36.855256 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Checking segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:36.855630 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Network hostable DHCP agents. Network: 77fd2be7-62d4-4a17-a108-9198b949900a, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:16:36.916347 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa2b66ba-5130-41c9-9666-93c8e6eedee4,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:36.918553 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Network 679d7722-330c-49b6-b5b8-e851267c2357 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92421) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:16:36.924143 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.327s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:36.957430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.013624 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.016042 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Network 77fd2be7-62d4-4a17-a108-9198b949900a is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:16:37.090291 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 679d7722-330c-49b6-b5b8-e851267c2357) {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:37.096607 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 77fd2be7-62d4-4a17-a108-9198b949900a) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:37.097170 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:37.099198 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.101258 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5822c67c-e58a-4fb7-bcfc-91ddc194e874 None None] Network 679d7722-330c-49b6-b5b8-e851267c2357 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:37.110475 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:37.111085 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.138482 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55776) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:37.142513 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-152b020e-7820-4f31-b515-cd7e69111f11 None None] Network 77fd2be7-62d4-4a17-a108-9198b949900a requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:37.216936 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.5559218
May 20 16:16:37.295704 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Allocated IP 172.27.0.41 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:37.344278 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 1.8480296
May 20 16:16:37.348037 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 55788) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:37.356104 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:37.357670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.362547 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:37.388077 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:37.397848 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Usage tracker for resource:security_group_rule and tenant:bfb35be52f914732830e6d20bf5ed5d1 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:37.403868 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:37.418444 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:37.470208 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Usage tracker for resource:router and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:37.477740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:37.493003 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:37.572734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.574666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.595756 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd44d494-da10-4baa-800c-4dd73ebe3fad None None] Network 679d7722-330c-49b6-b5b8-e851267c2357 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:37.598357 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.607057 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-77fd2be7-62d4-4a17-a108-9198b949900a', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:16:37.607998 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.637408 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.658657 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.712043 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55812) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:37.715937 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.720069 dv-cinder-689486-13-iscsi neutron-server[92421]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 20 16:16:37.889997 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:37.914663 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:37.926391 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-348310ae-2e67-4fd9-ab43-6329797694b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:37.928510 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-6d9ee19c-314f-47b8-940e-c2404a51f18d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:37.929228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-6d9ee19c-314f-47b8-940e-c2404a51f18d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Synchronizing usage tracker for tenant:747fc4332771467fa24e6bc07899b54f on resource:network {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:37.979985 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9409cb16-fdfc-4f15-858f-ec0183c1c004,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:37.984991 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:37.990223 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=bfb35be52f914732830e6d20bf5ed5d1&name=default HTTP/1.1" status: 200  len: 2975 time: 0.8505638
May 20 16:16:37.991233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55828) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:38.009602 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Allocated IP 172.20.0.2 (77fd2be7-62d4-4a17-a108-9198b949900a/aa2b66ba-5130-41c9-9666-93c8e6eedee4/27716f20-a4f5-40a5-9890-58a4c8e3f6e9) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:38.015750 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 55836) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:38.055666 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-6d9ee19c-314f-47b8-940e-c2404a51f18d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Unset dirty status for tenant:747fc4332771467fa24e6bc07899b54f on resource:network {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:38.056808 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-6d9ee19c-314f-47b8-940e-c2404a51f18d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.3427901
May 20 16:16:38.109207 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:38.144038 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-b84a388d-7880-4e38-a8bb-98ce08158a0b tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/quotas/747fc4332771467fa24e6bc07899b54f HTTP/1.1" status: 200  len: 375 time: 0.0726302
May 20 16:16:38.168536 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:38.181131 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:38.236786 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Pushing event updated for resources: {'Port': ['ID=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:38.249234 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-177eb321-9649-4c1c-a9e9-383374481a03 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0873225
May 20 16:16:38.264292 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.299830 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.300728 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-321a1da8-5c67-4d93-a46f-f28ab982b84a tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:38.301633 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-321a1da8-5c67-4d93-a46f-f28ab982b84a tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Synchronizing usage tracker for tenant:50d0b3d2f6dc41c492d29c820372735f on resource:network {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:38.310259 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.384s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:38.314104 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Transition to ACTIVE for port object 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:38.321356 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.352653 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Transition to ACTIVE for port object 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:38.375528 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.434773 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-a76f905a-038a-41cf-aa68-2210e9cea6d0 service neutron] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:16:38.439677 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-a76f905a-038a-41cf-aa68-2210e9cea6d0 service neutron] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0501530
May 20 16:16:38.496417 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.501010 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:38.532619 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.533335 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-321a1da8-5c67-4d93-a46f-f28ab982b84a tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Unset dirty status for tenant:50d0b3d2f6dc41c492d29c820372735f on resource:network {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:38.535218 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-321a1da8-5c67-4d93-a46f-f28ab982b84a tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/networks?id=679d7722-330c-49b6-b5b8-e851267c2357 HTTP/1.1" status: 200  len: 811 time: 0.5154641
May 20 16:16:38.548357 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:38.564187 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Network 77fd2be7-62d4-4a17-a108-9198b949900a is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:38.568118 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:38.571707 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:38.571899 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9409cb16-fdfc-4f15-858f-ec0183c1c004,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:38.577385 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:38.582068 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Pushing event updated for resources: {'Port': ['ID=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:38.583708 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-b5d745ac-a9b9-40a2-8429-84def7cf924c tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/quotas/50d0b3d2f6dc41c492d29c820372735f HTTP/1.1" status: 200  len: 375 time: 0.0249081
May 20 16:16:38.638103 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.638103 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/9409cb16-fdfc-4f15-858f-ec0183c1c004 HTTP/1.1" status: 204  len: 168 time: 0.6454563
May 20 16:16:38.667044 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-a0175509-9962-4fea-b22a-31c3acb6c2f3 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=50d0b3d2f6dc41c492d29c820372735f&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0748353
May 20 16:16:38.668749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.668749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.669313 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.669313 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.669631 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.669959 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.670274 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.670591 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.671014 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.671253 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.671663 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.671900 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Tracked resource versions report:
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]: pushed versions:
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]: {   'AddressGroup': {'1.2'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'ConntrackHelper': {'1.0'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Log': {'1.0'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Network': {'1.1'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Port': {'1.7'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'PortForwarding': {'1.2'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'QosPolicy': {'1.8'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'SecurityGroup': {'1.4'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'SecurityGroupRule': {'1.2'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'SubPort': {'1.0'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Subnet': {'1.1'},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     'Trunk': {'1.1'}}
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]: consumer versions:
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     HyperV agent@hv-cinder-68948: {},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'ConntrackHelper': '1.0',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Log': '1.0',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Network': '1.1',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Port': '1.7',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'PortForwarding': '1.2',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'QosPolicy': '1.8',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'SecurityGroup': '1.4',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'SecurityGroupRule': '1.2',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'SubPort': '1.0',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Subnet': '1.1',
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:                                                       'Trunk': '1.1'}}
May 20 16:16:38.673113 dv-cinder-689486-13-iscsi neutron-server[92423]:  {{(pid=92423) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:16:38.675582 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-c6eac8d8-727f-43a4-b5e5-37637f1aec1c service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2337720
May 20 16:16:38.680139 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:38.696955 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Attempting to bind port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:16:38.697328 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Attempting to bind port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:16:38.697691 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Attempting to bind port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 on network 77fd2be7-62d4-4a17-a108-9198b949900a {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:38.728181 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:16:38.728854 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Checking segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:38.729424 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.729970 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Bound using segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:16:38.730627 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Bound port: 27716f20-a4f5-40a5-9890-58a4c8e3f6e9, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:16:38.731211 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:38.875450 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-3c2a4dfd-e372-487d-bab0-93881aa48668 service neutron] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:16:38.882936 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-3c2a4dfd-e372-487d-bab0-93881aa48668 service neutron] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0966637
May 20 16:16:38.886173 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-7d4a92dd-d858-4ccb-922f-eca18d0d65ba service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2095652
May 20 16:16:38.901535 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] For port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:16:38.905568 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] For port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:16:38.998333 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:39.022814 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:39.033894 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-8fcab201-845c-4160-99f4-85cd029a85b7 service neutron] 10.222.0.64 "GET /v2.0/networks/679d7722-330c-49b6-b5b8-e851267c2357?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1499312
May 20 16:16:39.139207 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Pushing event updated for resources: {'Port': ['ID=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:39.153163 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:39.177748 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:39.257405 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-1c08a696-a936-4d25-bba2-119b59b9d6e2 service neutron] 10.222.0.64 "GET /v2.0/networks/679d7722-330c-49b6-b5b8-e851267c2357?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2173700
May 20 16:16:39.499486 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:39.541929 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:39.661166 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3a098c03-ec78-4d94-9de7-0b0ad3e589a0 req-d18ac683-f264-4642-9b08-9f409efebacc tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.0934913
May 20 16:16:39.947388 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2a03a466-c611-4a9e-a5c3-eb70758d28a2 req-8e403043-86dc-4ca7-8a43-bad294314154 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.0670035
May 20 16:16:39.957919 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Allocated IP 172.27.0.156 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/7f5d614c-c347-4c74-a29d-8f8c4b8ae27f) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:39.971030 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:40.401405 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:40.453187 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0809a51-40a9-4685-b57d-2eaab0be94a4 None None] Network 77fd2be7-62d4-4a17-a108-9198b949900a requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:16:40.538250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:40.539216 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Router b95b2402-e3e5-4f97-b17f-55814f64b9e1 is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92422) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:16:40.554430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:40.693749 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:40.708098 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:40.775015 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-dddbe7fb-b63d-4132-a7e8-4211002e34f6 None None] Provisioning for port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:16:40.789008 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:40.796338 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:40.809597 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c27add58-cca0-4580-a9c1-e32fc9624d60 req-0c13b397-917b-44c0-a2aa-156be1a01d7d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.0774045
May 20 16:16:40.894900 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:16:40.900459 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:40.901048 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:41.013801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Pushing event updated for resources: {'Port': ['ID=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:41.018813 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.464s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:41.065957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:41.110230 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-079bf154-bb52-4031-9337-0d6546776c66 req-5239c9d7-1917-4c45-85cd-3c6c8f7a5e21 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.0743237
May 20 16:16:41.125269 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:16:41.227253 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-206db42f-022e-4f8d-a25e-9901ec2178a5 None None] Provisioning complete for port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:41.227746 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-206db42f-022e-4f8d-a25e-9901ec2178a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:41.267319 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:41.276754 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-a5dee122-2656-4673-ac44-99f52193c40f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:41.399328 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:16:41.408131 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:41.408858 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Sync routers for ids ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:16:41.416791 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:41.422138 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Routers {'b95b2402-e3e5-4f97-b17f-55814f64b9e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:41.422939 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:41.423802 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71372fd90>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:41.616970 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:41.618186 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 6.0517795
May 20 16:16:41.621635 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56016) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:41.699386 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Set router b95b2402-e3e5-4f97-b17f-55814f64b9e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:41.847109 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.035261 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-131e8a97-f49c-45ec-bc8f-7d9dcf38ccc5 req-3724aa8c-b9bd-4456-9a94-209d305d4c94 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.0536280
May 20 16:16:42.067095 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71372fd90>, [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:16:38Z', 'revision_number': 3, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port': {'id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:f2:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:42.072285 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Checking router: b95b2402-e3e5-4f97-b17f-55814f64b9e1 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:16:42.072629 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Updating router b95b2402-e3e5-4f97-b17f-55814f64b9e1 port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:16:42.127433 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.147163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Router 7ca2542d-958b-4848-b460-42f1d2b2dd11 is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92422) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:16:42.335344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:16:42.344626 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Sync routers for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:16:42.349716 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4c88c1a7-883f-47ab-827a-0f5d26e92980 req-e331c164-850a-4f97-8567-fe17c54c0766 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.0562828
May 20 16:16:42.368646 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:42.369601 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7122f98e0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:42.415913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.419622 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 5.0683801
May 20 16:16:42.420006 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56044) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:42.536593 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.549115 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Transition to ACTIVE for port object 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:42.596590 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:42.617701 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.623957 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.631260 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-5c03714e-95ca-4e5e-90fb-5223a232a6be None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:42.676431 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:42.748566 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Attempting to bind port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:16:42.748933 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Attempting to bind port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:16:42.749295 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Attempting to bind port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:42.757836 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:16:42.758203 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:42.758784 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.759363 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:16:42.759975 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Bound port: 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:16:42.760516 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:42.795727 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Pushing event updated for resources: {'Port': ['ID=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,revision_number=2']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:42.822109 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.822766 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.823316 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.823857 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.824342 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.824840 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.825307 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.825838 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.826341 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.826817 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.827302 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.827823 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Tracked resource versions report:
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]: pushed versions:
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]: {   'AddressGroup': {'1.2'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'ConntrackHelper': {'1.0'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Log': {'1.0'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Network': {'1.1'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Port': {'1.7'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'PortForwarding': {'1.2'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'QosPolicy': {'1.8'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'SecurityGroup': {'1.4'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'SecurityGroupRule': {'1.2'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'SubPort': {'1.0'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Subnet': {'1.1'},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     'Trunk': {'1.1'}}
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]: consumer versions:
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]: {   DHCP agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     HyperV agent@hv-cinder-68948: {},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     L3 agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     Metadata agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     Metering agent@dv-cinder-689486-13-iscsi: {},
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:     Open vSwitch agent@dv-cinder-689486-13-iscsi: {   'AddressGroup': '1.2',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'ConntrackHelper': '1.0',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Log': '1.0',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Network': '1.1',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Port': '1.7',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'PortForwarding': '1.2',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'QosPolicy': '1.8',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'SecurityGroup': '1.4',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'SecurityGroupRule': '1.2',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'SubPort': '1.0',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Subnet': '1.1',
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:                                                       'Trunk': '1.1'}}
May 20 16:16:42.829567 dv-cinder-689486-13-iscsi neutron-server[92424]:  {{(pid=92424) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 16:16:42.837092 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:42.883739 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] For port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:16:42.886395 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Allocated IP 172.20.0.1 (6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4/a6f615bc-43ff-44ce-82a2-e2cbda58ee9e/eb882c39-3476-427e-b28d-c519a5094ad2) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:42.886977 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] For port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:16:43.003940 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:43.010028 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:43.071635 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:43.133215 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Routers {'b95b2402-e3e5-4f97-b17f-55814f64b9e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:43.133847 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71372fd90>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:43.167124 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:43.168121 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:43.212773 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Pushing event updated for resources: {'Port': ['ID=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:43.222614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:43.224648 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:43.228803 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:43.396247 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7122f98e0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:41Z', 'revision_number': 3, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:43.415267 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Checking router: 7ca2542d-958b-4848-b460-42f1d2b2dd11 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:16:43.419530 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Updating router 7ca2542d-958b-4848-b460-42f1d2b2dd11 port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:16:43.425679 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-428a3e5e-5839-4af4-a69a-90df9dd62940 req-c3ad9321-5239-457a-867c-8f7edbe2d0d1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.0880902
May 20 16:16:43.426515 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:43.431132 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:43.434942 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:43.436914 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Pushing event updated for resources: {'Port': ['ID=eb882c39-3476-427e-b28d-c519a5094ad2,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:43.449706 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:43.450535 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:43.459885 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] Set router b95b2402-e3e5-4f97-b17f-55814f64b9e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:43.530426 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:43.612186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.384s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:43.849032 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56076) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:43.980274 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b0e6bd88-6575-45c2-8557-a88eb08684a4 req-18217050-918f-468a-ba38-33765e98781e tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.1736963
May 20 16:16:44.031906 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Allocated IP 172.20.0.1 (77fd2be7-62d4-4a17-a108-9198b949900a/aa2b66ba-5130-41c9-9666-93c8e6eedee4/651066cd-47a2-415a-8605-8ad19ef01cb4) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:44.038268 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.062080 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Transition to ACTIVE for port object 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:44.076594 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71372fd90>, [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:16:38Z', 'revision_number': 3, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port': {'id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:f2:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:44.080917 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e32c33f-a335-40e4-955e-03208c2071ca None None] The sync data for ids ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'] in dv-cinder-689486-13-iscsi is: [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:16:38Z', 'revision_number': 3, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port': {'id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:f2:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:16:44.089310 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.129693 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.164986 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:44.172771 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.178091 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Usage tracker for resource:security_group_rule and tenant:ec90ce98f4014a0e8fbe178daa6b0aac is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:44.186982 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:44.187175 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:44.192283 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:44.246126 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.282331 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Transition to ACTIVE for port object 651066cd-47a2-415a-8605-8ad19ef01cb4 will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:44.346767 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Attempting to bind port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:16:44.347564 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Attempting to bind port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:16:44.348111 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Attempting to bind port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:44.348740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.362470 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:16:44.362856 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:44.363273 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.363759 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:16:44.364139 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Bound port: 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:16:44.364837 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.451814 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3894b79-7da6-4072-ae7d-b4e2203f9edf None None] Pushing event updated for resources: {'Port': ['ID=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:44.460876 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-b3894b79-7da6-4072-ae7d-b4e2203f9edf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:44.463139 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.463916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.465050 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.501097 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] For port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:16:44.503006 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-c1c15d3a-a168-496d-8db0-6cfe023ee0d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:44.504593 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] For port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:16:44.565451 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.573969 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.584368 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:44.603206 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Network 77fd2be7-62d4-4a17-a108-9198b949900a is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:44.613612 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:44.621960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:44.622575 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.622703 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:44.634655 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:44.642659 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ec90ce98f4014a0e8fbe178daa6b0aac&name=default HTTP/1.1" status: 200  len: 2975 time: 0.7897854
May 20 16:16:44.647754 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56094) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:44.648344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94622230-ab50-46fe-9647-7fec6e0ebea0,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:44.662816 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:44.663341 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a18485de-efe9-48cc-8d03-72aa59bc58c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.139s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:44.693149 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:44.757978 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Pushing event updated for resources: {'Port': ['ID=651066cd-47a2-415a-8605-8ad19ef01cb4,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:44.763212 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:44.900459 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:44.917195 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7122f98e0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:45.031817 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.052548 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07572f35-f1ce-4fba-9db1-ba6e5aa0463f req-c234cca7-fb29-41af-945b-1e42d7ab3463 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.4055114
May 20 16:16:45.107337 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.16', 54644) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:45.126774 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3894b79-7da6-4072-ae7d-b4e2203f9edf None None] Pushing event updated for resources: {'Port': ['ID=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:45.135555 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-b3894b79-7da6-4072-ae7d-b4e2203f9edf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.503s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:45.263125 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.289295 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-3c0ef685-c615-43f4-bf8b-e516ef0467c1 None None] Provisioning for port 651066cd-47a2-415a-8605-8ad19ef01cb4 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:16:45.293260 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:16:45.309594 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:45.309968 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.351005 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Pushing event updated for resources: {'Port': ['ID=eb882c39-3476-427e-b28d-c519a5094ad2,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:45.356351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-3c0ef685-c615-43f4-bf8b-e516ef0467c1 None None] Provisioning complete for port 651066cd-47a2-415a-8605-8ad19ef01cb4 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:45.356655 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3c0ef685-c615-43f4-bf8b-e516ef0467c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.373852 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.790s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:45.424310 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-3c0ef685-c615-43f4-bf8b-e516ef0467c1 None None] Port 651066cd-47a2-415a-8605-8ad19ef01cb4 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:16:45.444791 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ba50b1a-e97d-45dd-8282-709caa3479ac req-35eaeb82-741f-49e3-bf26-762c23622896 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.1252811
May 20 16:16:45.470030 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:45.480999 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.571780 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.578819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:45.582559 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:45.600530 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-d2d7ca6d-eead-4e0c-92e5-5776793b68ba tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:45.602218 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-d2d7ca6d-eead-4e0c-92e5-5776793b68ba tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.4756312
May 20 16:16:45.645140 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.647120 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.654013 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:45.674649 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Request body: {'port': {'device_id': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'admin_state_up': True, 'tenant_id': '747fc4332771467fa24e6bc07899b54f'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:45.790837 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56128) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:45.815364 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.831817 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Pushing event updated for resources: {'Port': ['ID=651066cd-47a2-415a-8605-8ad19ef01cb4,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:45.851000 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:45.867326 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:45.922651 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4f628d0b-217d-4612-a462-b93ef9525897 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:45.959983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:16:45.960484 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.16', 54648) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:45.963475 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b855c55b-4b44-471c-8c76-ecc6e0109fff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:46.119672 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94622230-ab50-46fe-9647-7fec6e0ebea0,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:46.160987 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:46.161885 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:46.178732 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:46.184158 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Usage tracker for resource:port and tenant:747fc4332771467fa24e6bc07899b54f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:46.188556 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:46.197085 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:46.229165 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:46.270250 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Router b95b2402-e3e5-4f97-b17f-55814f64b9e1 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:16:46.275668 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:46.282546 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-ee39ca8a-3f21-408c-bda9-710f481bed44 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:46.284490 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-ee39ca8a-3f21-408c-bda9-710f481bed44 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.16 "GET /v2.0/networks?id=679d7722-330c-49b6-b5b8-e851267c2357 HTTP/1.1" status: 200  len: 811 time: 0.3228374
May 20 16:16:46.292341 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Made reservation on behalf of 747fc4332771467fa24e6bc07899b54f for: {'port': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:46.297485 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:46.315332 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:46.318745 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Network 77fd2be7-62d4-4a17-a108-9198b949900a is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:46.321097 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:46.323375 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Usage tracker for resource:security_group_rule and tenant:b329d345d2604f9089d6cc6d1c0cbe56 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:46.337354 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:46.347488 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:46.464154 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:46.477317 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:46.480239 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7122f98e0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:46.490140 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7147024-c358-44c6-ac20-eba33658bbf7 None None] The sync data for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi is: [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:16:46.654252 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:46.693251 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Router 7ca2542d-958b-4848-b460-42f1d2b2dd11 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:16:46.734902 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:46.738976 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/94622230-ab50-46fe-9647-7fec6e0ebea0 HTTP/1.1" status: 204  len: 168 time: 2.0692320
May 20 16:16:46.840074 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Request body: {'port': {'device_id': '2103aba6-9c9a-4eef-a289-d656208928fc', 'network_id': '679d7722-330c-49b6-b5b8-e851267c2357', 'admin_state_up': True, 'tenant_id': '50d0b3d2f6dc41c492d29c820372735f'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:46.874142 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:46.875520 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:46.876231 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:46.963228 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:47.013474 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-00d3f3c4-545e-4010-b7a2-bc031187cbc8 req-1459b56b-927c-471f-90df-cbde8f104689 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.6649008
May 20 16:16:47.040742 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-7b2034a3-7249-466f-8177-d01365ff355f None None] Provisioning complete for port 651066cd-47a2-415a-8605-8ad19ef01cb4 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:47.040742 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7b2034a3-7249-466f-8177-d01365ff355f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:47.151174 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:47.190345 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:16:47.208101 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=451834a3-c3f4-4350-923c-793e786f0f47,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:47.211488 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:47.267614 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] 10.222.0.64 "PUT /v2.0/routers/7ca2542d-958b-4848-b460-42f1d2b2dd11/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.8384528
May 20 16:16:47.304604 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=b329d345d2604f9089d6cc6d1c0cbe56&name=default HTTP/1.1" status: 200  len: 2975 time: 1.4724073
May 20 16:16:47.337354 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56196) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:47.354402 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-7b2034a3-7249-466f-8177-d01365ff355f None None] Port 651066cd-47a2-415a-8605-8ad19ef01cb4 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:16:47.529692 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:47.529946 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c032d5c0-bb62-46fa-871a-eebd2c4f518f req-66d5c5d3-7ea7-41c1-9729-70e964ef9dc3 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.3397741
May 20 16:16:47.742437 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:47.744720 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:47.744720 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Usage tracker for resource:port and tenant:50d0b3d2f6dc41c492d29c820372735f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:47.744720 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:16:47.744720 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:47.745147 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Sync routers for ids ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:16:47.745522 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Allocated IP 172.20.0.14 (7250e4c3-f4ff-4878-8316-65dfc0975bd3/924a520e-53e5-4777-beb9-f9e6d0bd0dff/4b373943-e984-4276-9601-6ed0d000265f) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:47.745589 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Routers {'b95b2402-e3e5-4f97-b17f-55814f64b9e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:47.748235 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7129ac7f0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:47.750890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:47.792416 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] 10.222.0.64 "PUT /v2.0/routers/b95b2402-e3e5-4f97-b17f-55814f64b9e1/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.1695800
May 20 16:16:47.794560 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56206) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:47.876934 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:47.929458 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:47.961142 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Usage tracker for resource:security_group_rule and tenant:4b19c48afa424518bbb34a7569d1dbaa is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:47.970289 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:47.988725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:48.016004 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.020583 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:48.097808 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Made reservation on behalf of 50d0b3d2f6dc41c492d29c820372735f for: {'port': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:48.102547 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.104068 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=451834a3-c3f4-4350-923c-793e786f0f47,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:48.116564 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:48.128543 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.133454 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/451834a3-c3f4-4350-923c-793e786f0f47 HTTP/1.1" status: 204  len: 168 time: 0.7921851
May 20 16:16:48.473560 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Set router b95b2402-e3e5-4f97-b17f-55814f64b9e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:48.565645 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ccbc0314-93f7-49a7-abf2-ea683cd4283d req-fd524e8d-4a62-461a-9518-f9235567e577 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Synchronizing usage tracker for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:48.581227 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.684857 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c3f2f652-5ab0-402d-ad25-46b2516c18a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.725276 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.803883 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:48.886059 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.886878 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ccbc0314-93f7-49a7-abf2-ea683cd4283d req-fd524e8d-4a62-461a-9518-f9235567e577 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Unset dirty status for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:48.888079 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ccbc0314-93f7-49a7-abf2-ea683cd4283d req-fd524e8d-4a62-461a-9518-f9235567e577 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.4200697
May 20 16:16:48.908460 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:48.936708 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:49.126953 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:16:49.133333 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:49.133710 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.139213 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebed56c8-f41b-47b4-95a1-e04b9e887a36,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:49.166873 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=4b19c48afa424518bbb34a7569d1dbaa&name=default HTTP/1.1" status: 200  len: 2975 time: 1.3637831
May 20 16:16:49.168654 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56250) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:49.178359 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:49.180091 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Allocated IP 172.20.0.10 (679d7722-330c-49b6-b5b8-e851267c2357/62bb207d-d1f6-4694-870b-d608e6900fa3/0ea6d03c-015e-4b25-bea8-4db73fba158e) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:49.313778 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.356381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.366059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56256) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:49.379315 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'security_group': {'name': 'tempest-securitygroup--338431654', 'description': 'tempest-description--24532386'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:49.410260 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:49.430522 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:49.456597 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:49.490097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.493577 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:49.498202 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e7610d53-b6ce-4f12-a958-fdda75bf45e8 req-941b6ca5-69d4-4171-a33d-bce65583bbf4 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.1224022
May 20 16:16:49.543648 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.571996 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:49.581176 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7129ac7f0>, [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:16:43Z', 'revision_number': 4, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port': {'id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:f2:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'eb882c39-3476-427e-b28d-c519a5094ad2', 'name': '', 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'mac_address': 'fa:16:3e:b3:0a:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_interface', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:42Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 2, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'subnets': [{'id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:49.587151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:16:49.589517 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Checking router: b95b2402-e3e5-4f97-b17f-55814f64b9e1 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:16:49.591860 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Updating router b95b2402-e3e5-4f97-b17f-55814f64b9e1 port eb882c39-3476-427e-b28d-c519a5094ad2 binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:16:49.638816 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.640845 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.668817 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.675940 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:49.692937 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.714698 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:49.716929 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3c227829-ce1b-4d86-a7fc-9e55acee9397 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:49.724602 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.752538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:49.763856 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/ebed56c8-f41b-47b4-95a1-e04b9e887a36 HTTP/1.1" status: 204  len: 168 time: 0.5956204
May 20 16:16:49.767387 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group_rule and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:49.770372 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebed56c8-f41b-47b4-95a1-e04b9e887a36,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:49.794169 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:49.809790 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:49.822814 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:49.885087 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:49.898609 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:49.982456 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:50.046100 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.066789 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:50.070551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:50.075948 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:50.076559 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.135637 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.179496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:50.228605 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Sync routers for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:16:50.243093 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:50.244294 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71234bf40>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:50.292270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56286) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:50.294175 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7940f732-e859-47f1-9869-53f257121fca,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:50.299261 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:50.300235 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.305504 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1775 time: 0.9325871
May 20 16:16:50.311618 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56290) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:50.318788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'security_group_rule': {'security_group_id': '7940f732-e859-47f1-9869-53f257121fca', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:50.329132 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:50.338660 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group_rule and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:50.344255 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:50.351863 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:50.370027 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 4.7075920
May 20 16:16:50.430748 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.455310 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Transition to ACTIVE for port object eb882c39-3476-427e-b28d-c519a5094ad2 will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:50.466971 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event updated for resources: {'Port': ['ID=4b373943-e984-4276-9601-6ed0d000265f,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:50.474769 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.899s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:50.486320 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.510369 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.560965 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-c641ac1b-14d1-40c2-8e62-8f204f7e879c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:50.568041 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-c641ac1b-14d1-40c2-8e62-8f204f7e879c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 819 time: 0.5731246
May 20 16:16:50.574387 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.583409 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-7b09501c-8c96-469a-a7ae-6fa125fbd828 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:50.602038 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-f912d8e8-419c-4839-8366-3810f4a2e2ef tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/quotas/11c3c5cf74b64f749939ab72b3ea04ce HTTP/1.1" status: 200  len: 375 time: 0.0326047
May 20 16:16:50.644914 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:50.689828 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.692462 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae9f51f8-0b76-4256-a0a9-7cf1341f297e req-ae18e1c8-1063-4cf9-8c87-409da64441f7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:50.694439 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ae9f51f8-0b76-4256-a0a9-7cf1341f297e req-ae18e1c8-1063-4cf9-8c87-409da64441f7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 932 time: 0.5365353
May 20 16:16:50.746850 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.748836 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6ef9bb3-ab3f-4bd8-8c06-4f5deaebd7d5 None None] Pushing event updated for resources: {'Port': ['ID=eb882c39-3476-427e-b28d-c519a5094ad2,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:50.759226 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-d6ef9bb3-ab3f-4bd8-8c06-4f5deaebd7d5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:50.803493 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ae9f51f8-0b76-4256-a0a9-7cf1341f297e req-71f63d0b-01dc-4e02-a6df-048f6c47e151 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Synchronizing usage tracker for tenant:747fc4332771467fa24e6bc07899b54f on resource:security_group {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:50.813302 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a278e939-82c8-498b-b5a0-0cb1764a6389 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Synchronizing usage tracker for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:50.824870 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:50.836233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.844377 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:50.850783 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:50.863847 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=49d7f28f-1eec-4c6b-8c93-f9cd2d006c7e,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:50.869593 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:50.890384 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.891724 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5780687
May 20 16:16:50.894030 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Attempting to bind port eb882c39-3476-427e-b28d-c519a5094ad2 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:16:50.894447 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Attempting to bind port eb882c39-3476-427e-b28d-c519a5094ad2 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:16:50.894982 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56302) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:50.895112 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Attempting to bind port eb882c39-3476-427e-b28d-c519a5094ad2 on network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:50.899933 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'security_group_rule': {'security_group_id': '7940f732-e859-47f1-9869-53f257121fca', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:50.906771 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:16:50.907165 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Checking segment: {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:50.907462 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:50.907570 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.907953 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Bound using segment: {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:16:50.908428 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Bound port: eb882c39-3476-427e-b28d-c519a5094ad2, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:16:50.908797 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:50.924342 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group_rule and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:50.933876 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:50.941348 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:50.944804 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a278e939-82c8-498b-b5a0-0cb1764a6389 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Unset dirty status for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:50.957084 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a278e939-82c8-498b-b5a0-0cb1764a6389 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&fields=id HTTP/1.1" status: 200  len: 255 time: 0.3534875
May 20 16:16:51.021257 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.061168 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Network 679d7722-330c-49b6-b5b8-e851267c2357 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:51.064229 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ae9f51f8-0b76-4256-a0a9-7cf1341f297e req-71f63d0b-01dc-4e02-a6df-048f6c47e151 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Unset dirty status for tenant:747fc4332771467fa24e6bc07899b54f on resource:security_group {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:51.069026 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ae9f51f8-0b76-4256-a0a9-7cf1341f297e req-71f63d0b-01dc-4e02-a6df-048f6c47e151 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3568869
May 20 16:16:51.076874 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:51.083438 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:51.089101 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:51.089735 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.121643 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:51.134464 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] For port eb882c39-3476-427e-b28d-c519a5094ad2, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:16:51.144619 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] For port eb882c39-3476-427e-b28d-c519a5094ad2, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=eb882c39-3476-427e-b28d-c519a5094ad2,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:16:51.147409 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.222880 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Usage tracker for resource:security_group_rule and tenant:d0e6aeb3354b40239e78117e12219396 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:51.233395 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.239290 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:51.270823 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:51.320668 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:51.326483 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Pushing event updated for resources: {'Port': ['ID=0ea6d03c-015e-4b25-bea8-4db73fba158e,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:51.386216 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:51.386595 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.471986 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Routers {'b95b2402-e3e5-4f97-b17f-55814f64b9e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:51.472582 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7129ac7f0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:51.489010 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.494375 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 5.1419649
May 20 16:16:51.498066 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-818ac7ad-8329-4a1f-9f3e-5f459a6b9971 service neutron] 10.222.0.64 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5401895
May 20 16:16:51.499220 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.655s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:51.511618 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.569030 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.625499 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6ef9bb3-ab3f-4bd8-8c06-4f5deaebd7d5 None None] Pushing event updated for resources: {'Port': ['ID=eb882c39-3476-427e-b28d-c519a5094ad2,revision_number=4']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:51.630233 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-d6ef9bb3-ab3f-4bd8-8c06-4f5deaebd7d5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.391s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:51.638535 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-789b1330-e922-4d3a-9caa-f4c82af422ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:51.694511 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ff225d0-2cfd-449a-904d-0a59fea7e3f6,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:51.704377 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e69d427-70dd-4266-ad28-2b5e3ac2f879 req-debea74e-7bb9-44a7-812e-109469c0d813 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:51.705101 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e69d427-70dd-4266-ad28-2b5e3ac2f879 req-debea74e-7bb9-44a7-812e-109469c0d813 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Synchronizing usage tracker for tenant:50d0b3d2f6dc41c492d29c820372735f on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:51.708012 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:51.730921 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-365f8163-2f99-417d-9138-9d83d6229cd8 service neutron] 10.222.0.64 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2226002
May 20 16:16:51.741808 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.764752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.776616 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.8721015
May 20 16:16:51.778981 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56330) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:51.785835 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:51.793619 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:51.799806 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:floatingip and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:51.805493 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:51.818776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:51.844820 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e69d427-70dd-4266-ad28-2b5e3ac2f879 req-debea74e-7bb9-44a7-812e-109469c0d813 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Unset dirty status for tenant:50d0b3d2f6dc41c492d29c820372735f on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:51.846683 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e69d427-70dd-4266-ad28-2b5e3ac2f879 req-debea74e-7bb9-44a7-812e-109469c0d813 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 932 time: 0.4954512
May 20 16:16:51.891342 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:51.900989 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] Set router b95b2402-e3e5-4f97-b17f-55814f64b9e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:51.904493 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3049711c-f8d5-4e65-8158-7623672768ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:51.922323 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71234bf40>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:45Z', 'revision_number': 2, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:51.926749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Checking router: 7ca2542d-958b-4848-b460-42f1d2b2dd11 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:16:51.927347 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Updating router 7ca2542d-958b-4848-b460-42f1d2b2dd11 port 651066cd-47a2-415a-8605-8ad19ef01cb4 binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:16:51.955984 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=d0e6aeb3354b40239e78117e12219396&name=default HTTP/1.1" status: 200  len: 2977 time: 1.6586747
May 20 16:16:51.958321 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d641bf03-313d-4000-8c3f-07af8e00616b,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:51.960153 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56338) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:51.961420 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:51.987627 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.016301 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.080143 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e69d427-70dd-4266-ad28-2b5e3ac2f879 req-dddaea1f-1f53-4d20-bbf7-c8c572e2b33f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Synchronizing usage tracker for tenant:50d0b3d2f6dc41c492d29c820372735f on resource:security_group {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:52.118393 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.148575 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.219064 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e69d427-70dd-4266-ad28-2b5e3ac2f879 req-dddaea1f-1f53-4d20-bbf7-c8c572e2b33f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Unset dirty status for tenant:50d0b3d2f6dc41c492d29c820372735f on resource:security_group {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:52.221129 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e69d427-70dd-4266-ad28-2b5e3ac2f879 req-dddaea1f-1f53-4d20-bbf7-c8c572e2b33f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3637290
May 20 16:16:52.290826 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.297664 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bebbec7a-6772-428a-8baa-3bea9a25e2a2 req-ecabcc3b-1d5a-46ab-bf7d-e631dfac5d25 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0821030
May 20 16:16:52.300191 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.310878 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ac1d002b-f526-4a5c-aa12-f919548a2144 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:52.339871 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d641bf03-313d-4000-8c3f-07af8e00616b,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:52.364707 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:52.378442 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.383814 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d641bf03-313d-4000-8c3f-07af8e00616b HTTP/1.1" status: 204  len: 168 time: 0.4095287
May 20 16:16:52.584903 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7129ac7f0>, [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:16:43Z', 'revision_number': 4, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port': {'id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:f2:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'eb882c39-3476-427e-b28d-c519a5094ad2', 'name': '', 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'mac_address': 'fa:16:3e:b3:0a:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_interface', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:42Z', 'updated_at': '2021-05-20T16:16:51Z', 'revision_number': 4, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'subnets': [{'id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:52.595977 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c8750b-e718-4e9c-8791-95befe794d61 None None] The sync data for ids ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'] in dv-cinder-689486-13-iscsi is: [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:16:43Z', 'revision_number': 4, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port': {'id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:f2:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'eb882c39-3476-427e-b28d-c519a5094ad2', 'name': '', 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'mac_address': 'fa:16:3e:b3:0a:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_interface', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:42Z', 'updated_at': '2021-05-20T16:16:51Z', 'revision_number': 4, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'subnets': [{'id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:16:52.710598 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Allocated IP 172.27.0.28 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/4ecfeabb-5dfb-4697-ace2-8e5deb9243f4) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:52.770231 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ed8827-2f03-4c12-bb20-7a95bec75b71 req-94e83e5e-69d2-44c9-a418-d8329db19e50 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:52.779223 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-68ed8827-2f03-4c12-bb20-7a95bec75b71 req-94e83e5e-69d2-44c9-a418-d8329db19e50 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 932 time: 0.3655460
May 20 16:16:52.873866 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-68ed8827-2f03-4c12-bb20-7a95bec75b71 req-222ea9a9-c39b-438e-ac25-b46b2bb38a23 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0935225
May 20 16:16:52.878747 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:52.904414 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Transition to ACTIVE for port object 651066cd-47a2-415a-8605-8ad19ef01cb4 will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:53.038266 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:53.044342 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:53.372791 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:53.395224 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5927dcf2-4baf-4951-bdee-bfb4550599db tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:16:53.396705 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-5927dcf2-4baf-4951-bdee-bfb4550599db tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0767736
May 20 16:16:53.467913 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-3814169a-2f9b-4f4b-b9a0-189a9150596a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:16:53.478609 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-3814169a-2f9b-4f4b-b9a0-189a9150596a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1739776
May 20 16:16:53.505012 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-a44c6009-abee-40c0-a2d3-fbbca5834bee tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:53.515806 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-a44c6009-abee-40c0-a2d3-fbbca5834bee tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 819 time: 0.5600011
May 20 16:16:53.519206 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52af5d36-e592-4c7b-b3de-ae7d5d8617c7 None None] Pushing event updated for resources: {'Port': ['ID=651066cd-47a2-415a-8605-8ad19ef01cb4,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:53.523870 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-52af5d36-e592-4c7b-b3de-ae7d5d8617c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.479s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:53.559230 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:53.570430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:53.702479 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-107f7c2e-0d46-4536-abbf-84770e371bd7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/quotas/11c3c5cf74b64f749939ab72b3ea04ce HTTP/1.1" status: 200  len: 375 time: 0.1855667
May 20 16:16:53.728404 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Attempting to bind port 651066cd-47a2-415a-8605-8ad19ef01cb4 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:16:53.729953 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Attempting to bind port 651066cd-47a2-415a-8605-8ad19ef01cb4 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:16:53.732619 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Attempting to bind port 651066cd-47a2-415a-8605-8ad19ef01cb4 on network 77fd2be7-62d4-4a17-a108-9198b949900a {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:53.751640 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:16:53.753639 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Checking segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:53.756222 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:53.756663 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Bound using segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:16:53.757778 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Bound port: 651066cd-47a2-415a-8605-8ad19ef01cb4, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:16:53.759373 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:53.809291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:16:53.844346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:16:53.844533 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2fdbdb-0668-45e1-90ed-539be2ffd47e req-249afda5-75e2-4d8d-9f93-fa0f2d47f6f9 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:53.847016 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ad2fdbdb-0668-45e1-90ed-539be2ffd47e req-249afda5-75e2-4d8d-9f93-fa0f2d47f6f9 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 932 time: 0.3279550
May 20 16:16:53.849747 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'Port': ['ID=4ecfeabb-5dfb-4697-ace2-8e5deb9243f4,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:53.883703 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:16:53.970917 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-d971d1de-5780-4bbe-9e79-bb823384b938 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&fields=id HTTP/1.1" status: 200  len: 255 time: 0.2672527
May 20 16:16:53.996026 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] For port 651066cd-47a2-415a-8605-8ad19ef01cb4, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:16:54.000489 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] For port 651066cd-47a2-415a-8605-8ad19ef01cb4, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=651066cd-47a2-415a-8605-8ad19ef01cb4,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:16:54.039736 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.469s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:54.054622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Request body: {'port': {'device_id': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:54.079432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:54.079957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:54.084552 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-b3894b79-7da6-4072-ae7d-b4e2203f9edf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:54.154976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Request body: {'port': {'device_id': '2103aba6-9c9a-4eef-a289-d656208928fc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:54.277468 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52af5d36-e592-4c7b-b3de-ae7d5d8617c7 None None] Pushing event updated for resources: {'Port': ['ID=651066cd-47a2-415a-8605-8ad19ef01cb4,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:54.294011 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-52af5d36-e592-4c7b-b3de-ae7d5d8617c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:54.343815 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:16:54.357688 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71234bf40>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:16:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:54.358570 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ad2fdbdb-0668-45e1-90ed-539be2ffd47e req-a9aa5a5c-73f6-47fc-b0e9-47a86d354d85 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5025725
May 20 16:16:54.400899 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:54.963657 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:16:54.982389 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:16:55.066920 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device eb882c39-3476-427e-b28d-c519a5094ad2 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:55.238068 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:55.307226 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:55.324666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:55.509368 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:55.526408 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:55.556614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:55.593797 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-e2111ea9-fa13-44d5-bf5c-af0d10181108 service neutron] 10.222.0.64 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.6191919
May 20 16:16:55.688904 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'Port': ['ID=4ecfeabb-5dfb-4697-ace2-8e5deb9243f4,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:55.701563 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.379s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:55.805146 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:55.808597 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 4.0284629
May 20 16:16:55.815749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port eb882c39-3476-427e-b28d-c519a5094ad2 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:16:55.826075 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port eb882c39-3476-427e-b28d-c519a5094ad2 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:55.826537 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:55.832403 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56446) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:55.965315 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57489526-811a-478a-aa98-da266b1434e3 req-41ef3dc5-2d1f-4497-86c0-13eecc83f937 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:55.966927 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-57489526-811a-478a-aa98-da266b1434e3 req-41ef3dc5-2d1f-4497-86c0-13eecc83f937 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 932 time: 1.0378113
May 20 16:16:56.082527 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71234bf40>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:53Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:16:56.098240 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4068bf8e-386e-4af6-870c-435b32a2f55a None None] The sync data for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi is: [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:53Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:16:56.100530 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:56.189681 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port eb882c39-3476-427e-b28d-c519a5094ad2, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=eb882c39-3476-427e-b28d-c519a5094ad2,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:16:56.294965 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1473258846-network', 'tenant_id': 'f5739e05b86f4951acde901fb4b8cfc0'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:56.295815 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:56.297050 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 651066cd-47a2-415a-8605-8ad19ef01cb4 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:56.300246 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:56.304198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Usage tracker for resource:network and tenant:f5739e05b86f4951acde901fb4b8cfc0 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:56.327394 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:56.339505 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:56.357745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:56.434329 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-57489526-811a-478a-aa98-da266b1434e3 req-fb8d7fff-6bdd-4a76-84df-eb445d4e9643 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4320786
May 20 16:16:56.470028 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-b19a6e33-49aa-44e7-b485-327a329f4598 service neutron] 10.222.0.64 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8727129
May 20 16:16:56.477973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Made reservation on behalf of f5739e05b86f4951acde901fb4b8cfc0 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:56.480554 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:56.513559 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:56.533624 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=eb882c39-3476-427e-b28d-c519a5094ad2,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:56.539388 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:56.551084 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:56.555812 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Usage tracker for resource:security_group_rule and tenant:f5739e05b86f4951acde901fb4b8cfc0 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:56.559373 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:56.566758 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:56.639143 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 651066cd-47a2-415a-8605-8ad19ef01cb4 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:16:56.647026 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 651066cd-47a2-415a-8605-8ad19ef01cb4 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:56.647417 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:56.743461 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:56.849013 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:56.860744 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:56.902181 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.16', 54666) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:56.974556 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.052301 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 651066cd-47a2-415a-8605-8ad19ef01cb4, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=651066cd-47a2-415a-8605-8ad19ef01cb4,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:16:57.067321 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] vlan segment allocate from pool success with {'vlan_id': 627, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:16:57.087036 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.db.resource_extend [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 20 16:16:57.100878 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d41beefd-97c7-49ec-a915-0183d4f0d002,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:57.155845 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:57.187597 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.190794 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f186c71d-1b5c-45a9-951b-17c0fd2a00ac None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:57.214992 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.db.resource_extend [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 20 16:16:57.285134 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-ff116969-60ff-40f8-b96d-bc4cea1be971 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Synchronizing usage tracker for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:security_group {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:57.404297 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device eb882c39-3476-427e-b28d-c519a5094ad2 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:57.456134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-45b1b42d-3d20-4c2e-b70e-57da1c8fa1ed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:57.466031 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-45b1b42d-3d20-4c2e-b70e-57da1c8fa1ed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Synchronizing usage tracker for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:network {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:57.469687 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.470250 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Added segment fbb0e2c9-867a-43b3-a337-cba9bc64a01c of type vlan for network 597c1087-197a-4c41-acd4-22ded3976be3
May 20 16:16:57.520789 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0ea6d03c-015e-4b25-bea8-4db73fba158e {{(pid=92421) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:16:57.528801 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=651066cd-47a2-415a-8605-8ad19ef01cb4,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:57.537204 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.346s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:57.563704 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56500) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:57.567645 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.577621 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port eb882c39-3476-427e-b28d-c519a5094ad2 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:57.578341 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.588887 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f9764e-02ef-494f-a043-b62edd083bb4 req-ba8224c8-0729-4a52-afde-07cfb49b1849 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:57.599715 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-45b1b42d-3d20-4c2e-b70e-57da1c8fa1ed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Unset dirty status for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:network {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:57.603631 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-45b1b42d-3d20-4c2e-b70e-57da1c8fa1ed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 819 time: 0.6953971
May 20 16:16:57.605842 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75f9764e-02ef-494f-a043-b62edd083bb4 req-ba8224c8-0729-4a52-afde-07cfb49b1849 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 932 time: 0.8799479
May 20 16:16:57.610449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.694738 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Request body: {'port': {'device_id': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'admin_state_up': True, 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:57.767458 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75f9764e-02ef-494f-a043-b62edd083bb4 req-ef809904-9254-434a-be24-a0aa7e3d41a4 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1567011
May 20 16:16:57.768237 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-ff116969-60ff-40f8-b96d-bc4cea1be971 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Unset dirty status for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:security_group {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:57.793391 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-ff116969-60ff-40f8-b96d-bc4cea1be971 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-securitygroup--338431654&fields=id&tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 267 time: 0.8656318
May 20 16:16:57.852072 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.864182 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b373943-e984-4276-9601-6ed0d000265f {{(pid=92421) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:16:57.922807 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:57.923422 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:57.944303 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4878f3a-d909-4aaf-b8ae-8c182308639b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:57.946069 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:58.064756 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Pushing event updated for resources: {'Network': ['ID=597c1087-197a-4c41-acd4-22ded3976be3,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:58.080079 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 597c1087-197a-4c41-acd4-22ded3976be3 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:16:58.082629 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:58.082629 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:58.113240 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:58.114623 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-49698256-93b4-4604-ba2e-8609f8af73d6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:58.115854 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-49698256-93b4-4604-ba2e-8609f8af73d6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Synchronizing usage tracker for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:network {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:16:58.122720 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Transition to ACTIVE for port object 0ea6d03c-015e-4b25-bea8-4db73fba158e will not be triggered until provisioned by entity L2. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:58.132193 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Usage tracker for resource:security_group_rule and tenant:4e9f8dec19d24f1b843e48d521490891 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:58.147068 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:58.163330 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:58.168541 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Transition to ACTIVE for port object 4b373943-e984-4276-9601-6ed0d000265f will not be triggered until provisioned by entity L2. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:16:58.173785 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:58.186149 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:58.204302 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:58.208828 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:58.243768 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 2.4067914
May 20 16:16:58.249364 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56524) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:58.301558 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Request body: {'subnet': {'network_id': '597c1087-197a-4c41-acd4-22ded3976be3', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1473258846-subnet', 'tenant_id': 'f5739e05b86f4951acde901fb4b8cfc0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:16:58.303158 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-49698256-93b4-4604-ba2e-8609f8af73d6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Unset dirty status for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:network {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:16:58.304360 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-49698256-93b4-4604-ba2e-8609f8af73d6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 817 time: 0.5097830
May 20 16:16:58.304941 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:58.339734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:16:58.345769 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Made reservation on behalf of 11c3c5cf74b64f749939ab72b3ea04ce for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:58.359592 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:58.384561 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Usage tracker for resource:subnet and tenant:f5739e05b86f4951acde901fb4b8cfc0 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:16:58.409606 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:16:58.796917 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:16:58.796917 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:58.798804 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Pushing event updated for resources: {'Port': ['ID=0ea6d03c-015e-4b25-bea8-4db73fba158e,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:58.798804 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:58.798804 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5d7af1db-7e8a-4a71-8d59-3b7768ab10fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.200s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:58.798804 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-9fc8455b-94ac-4e96-a78b-6bf8f978b8be tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/quotas/ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 375 time: 0.3518450
May 20 16:16:58.798804 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8fedd547-2c70-41ef-aee9-ddc648179bc3 req-66b2a589-c8a5-4997-8c4a-6b0aed0a1e65 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 210 time: 0.3581169
May 20 16:16:58.799431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Allocated IP 172.20.0.7 (6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4/a6f615bc-43ff-44ce-82a2-e2cbda58ee9e/6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:16:58.989445 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Pushing event updated for resources: {'Port': ['ID=4b373943-e984-4276-9601-6ed0d000265f,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:58.996009 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.385s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:59.012078 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Attempting to bind port 0ea6d03c-015e-4b25-bea8-4db73fba158e on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:16:59.012441 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Attempting to bind port 0ea6d03c-015e-4b25-bea8-4db73fba158e by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '6693d38d-3373-4cfe-8791-6de4025dd8b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '679d7722-330c-49b6-b5b8-e851267c2357'}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:16:59.012811 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Attempting to bind port 0ea6d03c-015e-4b25-bea8-4db73fba158e on network 679d7722-330c-49b6-b5b8-e851267c2357 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:59.028700 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.068569 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Made reservation on behalf of f5739e05b86f4951acde901fb4b8cfc0 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:16:59.068569 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.068569 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.069188 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Port 0ea6d03c-015e-4b25-bea8-4db73fba158e on network 679d7722-330c-49b6-b5b8-e851267c2357 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:16:59.069188 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Attempting to bind port 0ea6d03c-015e-4b25-bea8-4db73fba158e on network 679d7722-330c-49b6-b5b8-e851267c2357 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:59.109810 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5359358f-0cea-43d4-96d6-fbe5c7a63ffb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:59.120011 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:16:59.120711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Checking segment: {'id': '6693d38d-3373-4cfe-8791-6de4025dd8b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '679d7722-330c-49b6-b5b8-e851267c2357'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:59.121011 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Bound using segment: {'id': '6693d38d-3373-4cfe-8791-6de4025dd8b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '679d7722-330c-49b6-b5b8-e851267c2357'} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:16:59.121406 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Bound port: 0ea6d03c-015e-4b25-bea8-4db73fba158e, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6693d38d-3373-4cfe-8791-6de4025dd8b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '679d7722-330c-49b6-b5b8-e851267c2357'}}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:16:59.121923 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.123363 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.147088 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Attempting to bind port 4b373943-e984-4276-9601-6ed0d000265f on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:16:59.147088 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Attempting to bind port 4b373943-e984-4276-9601-6ed0d000265f by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:16:59.147435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Attempting to bind port 4b373943-e984-4276-9601-6ed0d000265f on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:59.213954 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Port 4b373943-e984-4276-9601-6ed0d000265f on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:16:59.214374 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Attempting to bind port 4b373943-e984-4276-9601-6ed0d000265f on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:16:59.227633 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:16:59.228670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Checking segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:16:59.228670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Bound using segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:16:59.228861 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Bound port: 4b373943-e984-4276-9601-6ed0d000265f, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:16:59.229158 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.283037 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48c2cfca-4de7-4c45-a74d-980687d1b0ab,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:16:59.294290 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-4ade7020-25f9-4de5-b5f1-bbff6b2bb225 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&fields=id HTTP/1.1" status: 200  len: 348 time: 0.5706155
May 20 16:16:59.295706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:16:59.305167 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=4e9f8dec19d24f1b843e48d521490891&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7403710
May 20 16:16:59.314052 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56532) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:16:59.378352 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2145ca-5cb4-4db1-8baa-2246f9142a44 req-cc1d55b5-964b-4cd2-a060-94b2adbd96f4 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:16:59.379992 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9a2145ca-5cb4-4db1-8baa-2246f9142a44 req-cc1d55b5-964b-4cd2-a060-94b2adbd96f4 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.4361684
May 20 16:16:59.418945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] For port 0ea6d03c-015e-4b25-bea8-4db73fba158e, host hv-cinder-68948, cleared binding levels {{(pid=92421) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:16:59.509686 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 651066cd-47a2-415a-8605-8ad19ef01cb4 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:16:59.578172 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 651066cd-47a2-415a-8605-8ad19ef01cb4 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:16:59.578754 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.639397 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-f03c2ed4-59c0-4d15-9331-1fedd7baef04 service neutron] 10.222.0.64 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2985365
May 20 16:16:59.674030 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] For port 4b373943-e984-4276-9601-6ed0d000265f, host hv-cinder-68948, cleared binding levels {{(pid=92421) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:16:59.679274 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] For port 4b373943-e984-4276-9601-6ed0d000265f, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4b373943-e984-4276-9601-6ed0d000265f,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92421) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:16:59.681722 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] For port 0ea6d03c-015e-4b25-bea8-4db73fba158e, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=0ea6d03c-015e-4b25-bea8-4db73fba158e,segment=NetworkSegment(6693d38d-3373-4cfe-8791-6de4025dd8b2),segment_id=6693d38d-3373-4cfe-8791-6de4025dd8b2)] {{(pid=92421) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:16:59.716041 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9a2145ca-5cb4-4db1-8baa-2246f9142a44 req-a128874e-8c9b-47b7-961d-6cf071a6ad96 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3234954
May 20 16:16:59.758778 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.829870 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.866212 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-5dd12f15-c4c1-4ca0-8faa-4bf3f778d143 service neutron] 10.222.0.64 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2253597
May 20 16:16:59.903586 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.927803 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:16:59.940303 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.952806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:16:59.953486 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:00.042933 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:00.043593 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:00.045128 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] 10.222.0.16 "PUT /v2.0/ports/0ea6d03c-015e-4b25-bea8-4db73fba158e HTTP/1.1" status: 200  len: 1094 time: 6.3640521
May 20 16:17:00.057368 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2103aba6-9c9a-4eef-a289-d656208928fc', 'tag': '0ea6d03c-015e-4b25-bea8-4db73fba158e'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:00.082534 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:17:00.087414 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:17:00.089818 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:00.092477 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:17:00.098353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:00.099022 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:00.118215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:00.119109 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:00.120480 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] 10.222.0.16 "PUT /v2.0/ports/4b373943-e984-4276-9601-6ed0d000265f HTTP/1.1" status: 200  len: 1094 time: 6.4422445
May 20 16:17:00.125009 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Pushing event updated for resources: {'Port': ['ID=0ea6d03c-015e-4b25-bea8-4db73fba158e,revision_number=3']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:00.149084 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Pushing event updated for resources: {'Port': ['ID=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:00.158132 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:00.163344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.030s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:00.213578 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1451bd1-4018-4d0d-acf3-862454632b2c req-d172b177-56f0-44a8-9dd9-764bdf08a420 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:00.215450 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1451bd1-4018-4d0d-acf3-862454632b2c req-d172b177-56f0-44a8-9dd9-764bdf08a420 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 944 time: 0.3337066
May 20 16:17:00.247449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Pushing event updated for resources: {'Port': ['ID=4b373943-e984-4276-9601-6ed0d000265f,revision_number=3']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:00.261099 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48c2cfca-4de7-4c45-a74d-980687d1b0ab,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:00.262297 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:00.266585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:00.291533 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.249s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:00.291982 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:00.357640 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.6959262
May 20 16:17:00.410451 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1451bd1-4018-4d0d-acf3-862454632b2c req-37bbacb2-f851-4c73-8e0a-bbab7e48d4c1 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1851053
May 20 16:17:00.413850 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Request body: {'port': {'device_id': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:00.635209 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:00.638917 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/48c2cfca-4de7-4c45-a74d-980687d1b0ab HTTP/1.1" status: 204  len: 168 time: 1.3211198
May 20 16:17:00.758157 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:00.759468 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:00.778490 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a4cc46d2-a53b-4a3b-8dde-4773a929f5f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:00.788481 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a9fa5975-e4f8-43bb-8082-593f3ebb0218 req-55b3f38b-295b-473a-97c5-7a8aa48737f7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.2147222
May 20 16:17:00.806873 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ed90782b-10ca-486a-9aa2-b090ba1555c8 req-7bb4a6f2-8cbc-4fab-8adc-ec0da759e3f8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 210 time: 0.2279756
May 20 16:17:00.839684 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=96f449ed-0a00-4b3c-9966-9a45d066947f,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:00.910205 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-00148914-46da-47b2-84c3-9bbb68498c65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:00.912018 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-00148914-46da-47b2-84c3-9bbb68498c65 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 1097 time: 0.4992349
May 20 16:17:00.913715 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:00.918194 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-1f600832-da5b-4726-bfb6-18e28d4f5343 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:00.920108 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-1f600832-da5b-4726-bfb6-18e28d4f5343 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=50d0b3d2f6dc41c492d29c820372735f&device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 1097 time: 0.3475151
May 20 16:17:01.032967 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Checking segment: {'id': 'fbb0e2c9-867a-43b3-a337-cba9bc64a01c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '597c1087-197a-4c41-acd4-22ded3976be3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:17:01.033329 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Network hostable DHCP agents. Network: 597c1087-197a-4c41-acd4-22ded3976be3, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:17:01.209777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Network 597c1087-197a-4c41-acd4-22ded3976be3 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:17:01.250940 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-d5f4f335-15e6-411e-9bcf-26be1c79b8f7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4b373943-e984-4276-9601-6ed0d000265f HTTP/1.1" status: 200  len: 217 time: 0.3047352
May 20 16:17:01.269577 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-e9e86e60-7efa-4be4-8cd9-499f297a08f8 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0ea6d03c-015e-4b25-bea8-4db73fba158e HTTP/1.1" status: 200  len: 217 time: 0.3282382
May 20 16:17:01.353143 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 597c1087-197a-4c41-acd4-22ded3976be3) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:17:01.362455 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65f7660f-ac8b-4147-8c60-1a7fbeb7b21f None None] Network 597c1087-197a-4c41-acd4-22ded3976be3 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:17:01.366843 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:01.369023 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:01.408173 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2103aba6-9c9a-4eef-a289-d656208928fc', 'tag': '0ea6d03c-015e-4b25-bea8-4db73fba158e', 'status': 'completed', 'code': 200}
May 20 16:17:01.526932 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-e0d5e021-1942-485e-9f8f-85dab0b121a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:01.528427 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-e0d5e021-1942-485e-9f8f-85dab0b121a5 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 200  len: 855 time: 0.2455544
May 20 16:17:01.543451 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 3.2837276
May 20 16:17:01.543451 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:01.560048 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3969b3cd-f04f-4494-bee3-7e9cc81e8a6b req-edfb5900-f8a9-4927-8592-771b81d06aaf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:01.562175 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3969b3cd-f04f-4494-bee3-7e9cc81e8a6b req-edfb5900-f8a9-4927-8592-771b81d06aaf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.4170454
May 20 16:17:01.564416 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:01.603504 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.16', 54672) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:01.604714 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Transition to ACTIVE for port object 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:17:01.719650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:01.744127 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:01.798422 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c819c485-121e-4a51-af63-ce1f04c07e13 None None] Network 597c1087-197a-4c41-acd4-22ded3976be3 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:17:01.867326 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56602) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:01.967041 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-84e2c2b0-e52c-47f1-86d6-08a4ea23f9ef tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:01.969008 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-84e2c2b0-e52c-47f1-86d6-08a4ea23f9ef tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 819 time: 0.3426673
May 20 16:17:02.027820 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:02.052914 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-83d63815-3d67-4534-8322-ed46971d7359 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=7250e4c3-f4ff-4878-8316-65dfc0975bd3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.4385123
May 20 16:17:02.062083 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:02.066158 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Usage tracker for resource:security_group_rule and tenant:ea61ae59e5544725828d3e9179816cc5 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:02.069340 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:02.075490 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:02.215609 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Request body: {'port': {'device_id': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'admin_state_up': True, 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:02.220876 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3969b3cd-f04f-4494-bee3-7e9cc81e8a6b req-96516052-47ee-40fd-8eab-32402f2570b2 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6394594
May 20 16:17:02.266021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-65593614-c080-4e99-a429-3efcb17d23b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:02.269439 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-65593614-c080-4e99-a429-3efcb17d23b2 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=62bb207d-d1f6-4694-870b-d608e6900fa3 HTTP/1.1" status: 200  len: 851 time: 0.5576439
May 20 16:17:02.449102 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56614) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:02.534158 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-1bdcae98-ae0c-449e-b1ec-abdcbab22f4d service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=679d7722-330c-49b6-b5b8-e851267c2357&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1339099
May 20 16:17:02.604193 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-34f8e8e6-1e15-4339-abcd-1cb3bbf3e7e4 req-f694731b-4aec-49ae-aefa-7dc2096863e6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 210 time: 0.1401780
May 20 16:17:02.717492 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d50f0c-8740-44ea-90ee-f54ed4e4cb24 req-ebadfeee-e330-46e9-8309-d64df7acb953 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:02.728005 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-15d50f0c-8740-44ea-90ee-f54ed4e4cb24 req-ebadfeee-e330-46e9-8309-d64df7acb953 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 944 time: 0.8788579
May 20 16:17:02.736218 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Pushing event updated for resources: {'Port': ['ID=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:02.754207 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.016s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:02.811318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Attempting to bind port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:17:02.819812 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Attempting to bind port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:17:02.820256 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Attempting to bind port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 on network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:02.847887 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:02.875670 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Usage tracker for resource:port and tenant:11c3c5cf74b64f749939ab72b3ea04ce is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:02.882086 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 on network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:17:02.883043 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Attempting to bind port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 on network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:02.886061 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:02.907457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:02.907457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:17:02.907457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Checking segment: {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:17:02.907457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Bound using segment: {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:17:02.907457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Bound port: 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:17:02.907457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:02.964404 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-a352e0f9-77f7-4169-aea8-29c1c480d229 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.8523159
May 20 16:17:03.003336 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Made reservation on behalf of 11c3c5cf74b64f749939ab72b3ea04ce for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:17:03.008898 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.101205 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.132447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] For port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:17:03.139615 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c3f646ca-667f-4cc3-aca0-600586cc3d62 req-f3840f6e-1e9a-49d9-bbfa-35457a678a6d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.1466775
May 20 16:17:03.148654 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-15d50f0c-8740-44ea-90ee-f54ed4e4cb24 req-f5f945f5-a134-4f27-9701-295900880159 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4183178
May 20 16:17:03.152307 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] For port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:17:03.196097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.197511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:03.207061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Usage tracker for resource:security_group_rule and tenant:7aad2ca9d7764892bbddb3f9e882b2b5 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:03.211863 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:03.218076 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-efd8dc4b-041a-4d64-ba4d-4949922b5d2b service neutron] 10.222.0.16 "GET /v2.0/networks/679d7722-330c-49b6-b5b8-e851267c2357?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6549413
May 20 16:17:03.232053 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:03.270599 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.271548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.298475 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d23e1eb-6ac3-40ec-bef8-7973009bc021 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:03.413927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56646) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:03.416841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:03.426147 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ea61ae59e5544725828d3e9179816cc5&name=default HTTP/1.1" status: 200  len: 2979 time: 1.5577357
May 20 16:17:03.426456 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2108628070-network', 'tenant_id': '41051fd136554568893086f02d058b53'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:03.427311 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'tag': '4b373943-e984-4276-9601-6ed0d000265f'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:03.433539 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56650) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:03.442716 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:03.453764 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:03.454392 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.455991 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] 10.222.0.16 "PUT /v2.0/ports/6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 1093 time: 3.0569060
May 20 16:17:03.469451 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'tag': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:03.520076 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'tag': '4b373943-e984-4276-9601-6ed0d000265f', 'status': 'completed', 'code': 200}
May 20 16:17:03.534527 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.538261 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Usage tracker for resource:network and tenant:41051fd136554568893086f02d058b53 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:03.549285 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbfbe780-a367-4f3e-a24a-71e244e20015,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:03.553674 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:03.569153 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Allocated IP 172.20.0.13 (6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4/a6f615bc-43ff-44ce-82a2-e2cbda58ee9e/12e95041-05fa-4910-ada4-e349ed594896) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:17:03.569725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-831d74ca-e84c-40b3-b45f-eb7d84a52e3e req-388d019f-0843-4240-b51d-16f85d611039 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:03.572119 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-831d74ca-e84c-40b3-b45f-eb7d84a52e3e req-388d019f-0843-4240-b51d-16f85d611039 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.1369877
May 20 16:17:03.575575 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:03.597530 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Pushing event updated for resources: {'Port': ['ID=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:03.609126 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.613733 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.322s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:03.614991 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:03.685805 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-831d74ca-e84c-40b3-b45f-eb7d84a52e3e req-3dc98099-0035-4dd3-ad31-b2153d204d49 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1026747
May 20 16:17:03.691914 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.693931 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4f425248-ec25-4f15-84bd-ab41c9b6a2ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:03.704458 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=7aad2ca9d7764892bbddb3f9e882b2b5&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2542322
May 20 16:17:03.713183 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56664) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:03.725541 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Made reservation on behalf of 41051fd136554568893086f02d058b53 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:17:03.725541 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.797275 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.837745 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:03.909129 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:03.935028 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Usage tracker for resource:security_group_rule and tenant:41051fd136554568893086f02d058b53 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:03.951652 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:03.951652 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:03.957072 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3413e924-1055-468a-82d5-b182fc612590,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:03.970343 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-78b72f20-93ab-49b8-8577-d2a98e2e026d req-e5f4844d-8de1-47e1-bc6a-0930fd667e98 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 210 time: 0.1690676
May 20 16:17:03.973155 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:03.994434 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'tag': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0', 'status': 'completed', 'code': 200}
May 20 16:17:04.020149 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf3159f3-d031-4688-a1f2-fbf07a312419 req-75093f4f-439a-4926-97b6-8aab3c8c620a service neutron] 10.222.0.16 "GET /v2.0/networks/679d7722-330c-49b6-b5b8-e851267c2357?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3332336
May 20 16:17:04.024943 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab3c1a54-eba7-49c9-a55f-f9ed0c0fc035 req-9484ce47-a971-42c0-93d5-28d00f661682 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3328331
May 20 16:17:04.050519 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.062934 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.088942 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.188437 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.195717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:04.214714 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbfbe780-a367-4f3e-a24a-71e244e20015,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:04.219802 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:04.239883 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.241057 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/dbfbe780-a367-4f3e-a24a-71e244e20015 HTTP/1.1" status: 204  len: 168 time: 0.8013949
May 20 16:17:04.290050 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.296909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:04.366512 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:17:04.375968 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.385217 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:17:04.385843 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e98e9d5d-3bc5-41f7-9598-dc19fa555461 req-15510441-1d0b-49eb-97ed-7be95f538da2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.0653367
May 20 16:17:04.393027 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:17:04.404581 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:04.405975 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.428945 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Pushing event updated for resources: {'Port': ['ID=12e95041-05fa-4910-ada4-e349ed594896,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:04.438505 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:04.439561 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1f79e808-3eb6-4393-9576-de80122a808e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.011s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:04.442721 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2142212-2943-4c94-a486-b085045730c6 req-05e779c8-4b2b-4770-acc7-f89b92a2778f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:04.444451 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a2142212-2943-4c94-a486-b085045730c6 req-05e779c8-4b2b-4770-acc7-f89b92a2778f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 944 time: 0.1620607
May 20 16:17:04.451751 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.455779 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/3413e924-1055-468a-82d5-b182fc612590 HTTP/1.1" status: 204  len: 168 time: 0.7364624
May 20 16:17:04.457696 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3413e924-1055-468a-82d5-b182fc612590,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:04.463008 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:04.553859 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.561871 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a2142212-2943-4c94-a486-b085045730c6 req-af96cd7c-79ae-4349-9320-420bc808caa9 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1108382
May 20 16:17:04.570400 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.3672242
May 20 16:17:04.689497 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.692898 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:04.728623 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] vlan segment allocate from pool success with {'vlan_id': 621, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:17:04.741431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d58ded97-f485-46fd-bee3-db178651caaa,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:04.744779 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:04.757632 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.757983 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Added segment 257639ed-ca9e-49a4-813f-fa685b0954b8 of type vlan for network 56b7493d-1ccd-43e8-a5c2-064e49437d96
May 20 16:17:04.792952 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.885079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9c03f27-363a-4d83-8c7b-8728ec83090c req-e15328ba-5462-46ab-897f-1f763a486c25 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:04.887802 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b9c03f27-363a-4d83-8c7b-8728ec83090c req-e15328ba-5462-46ab-897f-1f763a486c25 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.0876074
May 20 16:17:04.938202 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b9c03f27-363a-4d83-8c7b-8728ec83090c req-f5041af5-a053-4573-8863-3904d208a2cc tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431273
May 20 16:17:04.946973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.948668 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:04.951378 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:04.955875 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:05.058832 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Pushing event updated for resources: {'Network': ['ID=56b7493d-1ccd-43e8-a5c2-064e49437d96,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:05.061922 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:05.070036 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 56b7493d-1ccd-43e8-a5c2-064e49437d96 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:17:05.102741 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 1.6869802
May 20 16:17:05.104500 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56702) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:05.113038 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Request body: {'subnet': {'network_id': '56b7493d-1ccd-43e8-a5c2-064e49437d96', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2108628070-subnet', 'tenant_id': '41051fd136554568893086f02d058b53', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:05.116258 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:05.120856 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Usage tracker for resource:subnet and tenant:41051fd136554568893086f02d058b53 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:05.124236 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:05.137523 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:05.253732 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae5178-b40e-434e-8be5-860cf3bd7263 req-0f15b0d7-57ca-401c-a81c-782e257ef6fa tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:05.255650 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bcae5178-b40e-434e-8be5-860cf3bd7263 req-0f15b0d7-57ca-401c-a81c-782e257ef6fa tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 932 time: 0.1642182
May 20 16:17:05.302466 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bcae5178-b40e-434e-8be5-860cf3bd7263 req-cacbde93-5d97-481c-bc50-856afa884b2b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411427
May 20 16:17:05.306647 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Made reservation on behalf of 41051fd136554568893086f02d058b53 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:17:05.309182 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:05.406130 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56712) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:05.429941 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:05.447508 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:05.451449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Usage tracker for resource:security_group_rule and tenant:be4f2f1926b14d5580985600770135ea is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:05.455490 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:05.461102 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:05.518954 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Request body: {'port': {'device_id': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:05.662869 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b9162307-a332-4cc7-aac0-0f799ccd6054 req-0eaa5ce8-95ae-4490-aff8-ae5861d63f42 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.0867774
May 20 16:17:05.724750 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:05.759842 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:05.834101 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-2ec3978a-c88a-4c23-9502-784f1f6fa178 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:05.835621 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-2ec3978a-c88a-4c23-9502-784f1f6fa178 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1096 time: 0.3220417
May 20 16:17:05.900837 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bd9f1d-e538-4cb6-951f-af043313640c req-b8fa2c68-5848-4716-9b34-9052c565f015 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:05.904016 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-b8fa2c68-5848-4716-9b34-9052c565f015 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 1097 time: 0.2454598
May 20 16:17:05.904016 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:05.922201 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f679-09f2-452f-980d-667f063a2147 req-a32ad23f-3356-4239-8e3a-958de9710f1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:05.923585 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-a32ad23f-3356-4239-8e3a-958de9710f1f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=50d0b3d2f6dc41c492d29c820372735f&device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 1097 time: 0.3003163
May 20 16:17:05.925944 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ed2a6f-4435-423d-9b76-a619d08f012f req-214b1b24-eab8-4ab0-8b0b-48580de83ca6 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:05.927614 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d5ed2a6f-4435-423d-9b76-a619d08f012f req-214b1b24-eab8-4ab0-8b0b-48580de83ca6 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 944 time: 0.2042964
May 20 16:17:05.928920 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-618d6479-2096-41aa-9e3e-77f8891029f5 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 217 time: 0.0864310
May 20 16:17:05.948015 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-fc90d779-f030-4053-9762-e27fb82a2d04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:06.124610 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=be4f2f1926b14d5580985600770135ea&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7168522
May 20 16:17:06.138240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56730) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:06.150086 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.16', 54678) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:06.203315 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=16f70ac0-ddca-4233-b61b-d70b23c9e648,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:06.229476 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:06.245059 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d5ed2a6f-4435-423d-9b76-a619d08f012f req-d301311f-28ba-4e5e-9c54-5ccb9c0ca6ad tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2878969
May 20 16:17:06.261197 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-398aea19-ba8f-4a7c-8e3b-f9e5d1a5fd50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:06.262628 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-398aea19-ba8f-4a7c-8e3b-f9e5d1a5fd50 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.2985451
May 20 16:17:06.324804 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bd9f1d-e538-4cb6-951f-af043313640c req-32e7ef1f-f0e8-4c42-83fd-f92fc66542ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:06.326326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-32e7ef1f-f0e8-4c42-83fd-f92fc66542ac service neutron] 10.222.0.16 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 916 time: 0.4143856
May 20 16:17:06.332939 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:06.366339 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:06.392197 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b039f2-0806-4f74-b63e-729be8bcc37a req-5eaf9bc6-f8fa-45c8-aaed-a8500b4837d8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:06.394709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f679-09f2-452f-980d-667f063a2147 req-c0b07f8f-de28-4c42-a378-ad38bf6c16a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:06.394845 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-92b039f2-0806-4f74-b63e-729be8bcc37a req-5eaf9bc6-f8fa-45c8-aaed-a8500b4837d8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.2555852
May 20 16:17:06.396172 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-c0b07f8f-de28-4c42-a378-ad38bf6c16a5 service neutron] 10.222.0.16 "GET /v2.0/networks?id=679d7722-330c-49b6-b5b8-e851267c2357 HTTP/1.1" status: 200  len: 912 time: 0.4288824
May 20 16:17:06.458285 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-fc175126-b82b-483a-8ddd-69a81f1261d9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:06.459734 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-fc175126-b82b-483a-8ddd-69a81f1261d9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 817 time: 0.2965021
May 20 16:17:06.515226 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-92b039f2-0806-4f74-b63e-729be8bcc37a req-b0b07406-a441-4180-86e5-b55794b6704a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1115284
May 20 16:17:06.560926 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7411d140-92db-4636-8e16-0acc34892e95 req-f741096d-1138-4e12-b3bd-d94dbf3b097b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:06.563379 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7411d140-92db-4636-8e16-0acc34892e95 req-f741096d-1138-4e12-b3bd-d94dbf3b097b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 932 time: 0.1207616
May 20 16:17:06.584916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 12e95041-05fa-4910-ada4-e349ed594896 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:06.593646 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:06.595425 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:06.602630 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:06.612270 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7411d140-92db-4636-8e16-0acc34892e95 req-f394d18f-e623-4a85-9946-038f37805bcd tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415659
May 20 16:17:06.732151 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Transition to ACTIVE for port object 12e95041-05fa-4910-ada4-e349ed594896 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:17:06.752400 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-72fa8b5e-e358-404e-9dc6-54d97a546ad2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0ea6d03c-015e-4b25-bea8-4db73fba158e HTTP/1.1" status: 200  len: 217 time: 0.1052287
May 20 16:17:06.783509 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:06.805604 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-926f6ab6-5345-45f0-8246-65745e8e9bd4 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1681242
May 20 16:17:06.812284 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=852ef265-25a6-4d3a-a921-bc6e998c70b8,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:06.827178 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-90683ef5-8447-4a35-8a99-f1d7117844c8 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4b373943-e984-4276-9601-6ed0d000265f HTTP/1.1" status: 200  len: 217 time: 0.1360333
May 20 16:17:06.828208 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:06.839120 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:06.853528 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-2243af8e-0aed-49b0-8cae-9a110c9d5d3b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Synchronizing usage tracker for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:security_group {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:17:06.862466 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:06.870840 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:06.899760 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Checking segment: {'id': '257639ed-ca9e-49a4-813f-fa685b0954b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '56b7493d-1ccd-43e8-a5c2-064e49437d96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:17:06.900111 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Network hostable DHCP agents. Network: 56b7493d-1ccd-43e8-a5c2-064e49437d96, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:17:06.990862 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f679-09f2-452f-980d-667f063a2147 req-17ecb54a-73d8-431f-be37-9ad9992abd55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:06.992268 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-17ecb54a-73d8-431f-be37-9ad9992abd55 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=62bb207d-d1f6-4694-870b-d608e6900fa3 HTTP/1.1" status: 200  len: 851 time: 0.2197034
May 20 16:17:07.006029 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-2243af8e-0aed-49b0-8cae-9a110c9d5d3b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Unset dirty status for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:security_group {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:17:07.007107 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-2243af8e-0aed-49b0-8cae-9a110c9d5d3b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 379 time: 0.3612409
May 20 16:17:07.070548 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Pushing event updated for resources: {'Port': ['ID=12e95041-05fa-4910-ada4-e349ed594896,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:07.076498 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'port': {'device_id': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'admin_state_up': True, 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'security_groups': ['7940f732-e859-47f1-9869-53f257121fca']}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:07.083934 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dc0dec4d-c989-49c4-8b84-ffe3c56ee091 req-46e5d1f4-6ba6-4341-99a3-0e71280d22e4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.0877087
May 20 16:17:07.086905 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16f70ac0-ddca-4233-b61b-d70b23c9e648,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:07.092365 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-8c82230d-5376-4464-a356-9a9a2dcc4780 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=679d7722-330c-49b6-b5b8-e851267c2357&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0888331
May 20 16:17:07.096931 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:07.109467 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:07.127024 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:07.130492 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/16f70ac0-ddca-4233-b61b-d70b23c9e648 HTTP/1.1" status: 204  len: 168 time: 0.9822822
May 20 16:17:07.177692 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bd9f1d-e538-4cb6-951f-af043313640c req-f385f10d-d831-49dc-a1fa-359a9db7a994 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:07.181832 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-f385f10d-d831-49dc-a1fa-359a9db7a994 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 200  len: 855 time: 0.3001540
May 20 16:17:07.185358 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Network 56b7493d-1ccd-43e8-a5c2-064e49437d96 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:17:07.259562 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-4fb75b94-ccc4-4338-b7ec-c8359da4ba21 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=7250e4c3-f4ff-4878-8316-65dfc0975bd3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0732679
May 20 16:17:07.263835 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-b4fed42d-8f00-413c-8b00-84550f32edd1 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4357157
May 20 16:17:07.324878 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Attempting to bind port 12e95041-05fa-4910-ada4-e349ed594896 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:17:07.325212 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Attempting to bind port 12e95041-05fa-4910-ada4-e349ed594896 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:17:07.325536 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Attempting to bind port 12e95041-05fa-4910-ada4-e349ed594896 on network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:07.360867 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 56b7493d-1ccd-43e8-a5c2-064e49437d96) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:17:07.362398 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Port 12e95041-05fa-4910-ada4-e349ed594896 on network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:17:07.362716 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Attempting to bind port 12e95041-05fa-4910-ada4-e349ed594896 on network 6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:07.369557 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29c19618-9c12-45a9-af96-0c29771e876d None None] Network 56b7493d-1ccd-43e8-a5c2-064e49437d96 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:17:07.375850 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:07.376432 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:07.384702 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:17:07.385034 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Checking segment: {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:17:07.385413 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Bound using segment: {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:17:07.385853 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Bound port: 12e95041-05fa-4910-ada4-e349ed594896, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e795581d-abe8-47e4-ab5f-18a44335be8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:17:07.386250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:07.621381 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-27aebc1b-d168-4001-94a4-0fe03d6553cb service neutron] 10.222.0.16 "GET /v2.0/networks/679d7722-330c-49b6-b5b8-e851267c2357?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4915805
May 20 16:17:07.625406 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:07.633809 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:port and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:07.655900 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:07.684472 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:07.697084 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 2.5915527
May 20 16:17:07.716606 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a209846-798e-45f4-9f69-0c9340fb6934 None None] Network 56b7493d-1ccd-43e8-a5c2-064e49437d96 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:17:07.809993 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] For port 12e95041-05fa-4910-ada4-e349ed594896, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:17:07.823841 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] For port 12e95041-05fa-4910-ada4-e349ed594896, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=12e95041-05fa-4910-ada4-e349ed594896,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:17:07.853281 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-f3b50201-3999-4553-ae69-3e3d85180628 service neutron] 10.222.0.16 "GET /v2.0/networks/679d7722-330c-49b6-b5b8-e851267c2357?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2223582
May 20 16:17:07.858077 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Made reservation on behalf of ddfbe809b7ae4afba7cc3bc0c9fc5984 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:17:07.870095 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:07.888111 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc871c34-06c4-42c9-9e87-dd13a568883a req-5a9bc76a-0463-42e7-ae3b-70c7071b8841 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5491035
May 20 16:17:07.915680 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-8ee6f0f1-4610-4889-987c-2682bb78a963 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6296978
May 20 16:17:07.940615 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-454e8bd3-29a8-462f-ac1c-2cda10949b05 req-184b8971-96c7-4fcc-9f2f-a926f78e47ac tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:07.948596 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-454e8bd3-29a8-462f-ac1c-2cda10949b05 req-184b8971-96c7-4fcc-9f2f-a926f78e47ac tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 944 time: 0.5136311
May 20 16:17:07.951529 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56808) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:07.959786 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:07.969138 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:08.071607 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:08.072297 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:08.073732 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] 10.222.0.16 "PUT /v2.0/ports/12e95041-05fa-4910-ada4-e349ed594896 HTTP/1.1" status: 200  len: 1094 time: 2.5596652
May 20 16:17:08.076167 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'tag': '12e95041-05fa-4910-ada4-e349ed594896'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:08.102246 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-454e8bd3-29a8-462f-ac1c-2cda10949b05 req-1e298016-4ca6-46a6-b03d-db972c69d725 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1529820
May 20 16:17:08.110467 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Deleting subnet 96f449ed-0a00-4b3c-9966-9a45d066947f {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:17:08.132901 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Pushing event updated for resources: {'Port': ['ID=12e95041-05fa-4910-ada4-e349ed594896,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:08.141864 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:08.171845 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f4713f-b632-4b74-9c88-ff52969e7dd6 req-b1f2d3ec-38f1-4385-9c63-38e3b28ea7db tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:08.173461 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03f4713f-b632-4b74-9c88-ff52969e7dd6 req-b1f2d3ec-38f1-4385-9c63-38e3b28ea7db tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.3780646
May 20 16:17:08.174220 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:08.188818 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Allocated IP 172.20.0.3 (77fd2be7-62d4-4a17-a108-9198b949900a/aa2b66ba-5130-41c9-9666-93c8e6eedee4/4c1d2c1d-f53f-4921-822b-db24d856090e) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:17:08.363169 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:08.436968 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03f4713f-b632-4b74-9c88-ff52969e7dd6 req-38a6f610-879f-48e2-95bd-3f19ee8bafda tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2187619
May 20 16:17:08.440794 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:08.483310 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-325018b8-2afa-4536-9ea4-b6ef0e9469a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:08.484840 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-325018b8-2afa-4536-9ea4-b6ef0e9469a5 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 1097 time: 0.2888565
May 20 16:17:08.517214 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-8b830c2c-c758-46b1-be2e-db2f7baf76b9 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4618735
May 20 16:17:08.567684 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'tag': '12e95041-05fa-4910-ada4-e349ed594896', 'status': 'completed', 'code': 200}
May 20 16:17:08.589593 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-c8633aa4-e8d7-46f4-bd37-e09a947795d8 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=12e95041-05fa-4910-ada4-e349ed594896 HTTP/1.1" status: 200  len: 217 time: 0.0945742
May 20 16:17:08.601085 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:08.606000 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe57b59-d27e-455d-af16-46598668e1cf req-c7e633a4-744d-4230-8bcb-7e21a47abff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:08.607958 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0fe57b59-d27e-455d-af16-46598668e1cf req-c7e633a4-744d-4230-8bcb-7e21a47abff3 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1096 time: 0.5034740
May 20 16:17:08.668210 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Transition to ACTIVE for port object 4c1d2c1d-f53f-4921-822b-db24d856090e will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:17:08.684762 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-6bb37e02-8a47-434a-bd8e-0da92bf7c0f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:08.685560 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-6bb37e02-8a47-434a-bd8e-0da92bf7c0f3 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0804191
May 20 16:17:08.742920 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-0d773944-47e8-44e3-be73-4827e1203127 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0458825
May 20 16:17:08.754130 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-15e19206-0e5e-4edd-8169-9ceccee97b83 req-dd15f81c-2c32-4dde-8d6b-da27df45a3fc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.1001518
May 20 16:17:08.767845 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4e0567-d07b-4aa6-9440-bdb83b42f089 req-0f7b1328-6473-47c6-a890-d77df1e98584 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:08.769365 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2e4e0567-d07b-4aa6-9440-bdb83b42f089 req-0f7b1328-6473-47c6-a890-d77df1e98584 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 944 time: 0.4089952
May 20 16:17:08.850666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:08.867759 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a04dac1f-4ed7-46a6-8a11-e08e56e923bc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:08.963897 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Network 77fd2be7-62d4-4a17-a108-9198b949900a is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:17:08.970709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:17:08.977368 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-bfdbf1dc-7b88-422f-801e-e5b002ae8200 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2251556
May 20 16:17:08.977649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:17:08.983101 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:08.984286 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:08.991002 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:08.996698 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:09.005337 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe57b59-d27e-455d-af16-46598668e1cf req-f8bd191f-4ad6-4d73-8c5b-d42251882876 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:09.007421 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0fe57b59-d27e-455d-af16-46598668e1cf req-f8bd191f-4ad6-4d73-8c5b-d42251882876 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.3553343
May 20 16:17:09.020628 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2e4e0567-d07b-4aa6-9440-bdb83b42f089 req-5eaa2b33-b39e-4dfa-85b2-b783ee3e7576 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1747251
May 20 16:17:09.109029 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0fe57b59-d27e-455d-af16-46598668e1cf req-6cb64349-0c2e-4091-899d-fd5dc3ede4bc service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 217 time: 0.0922294
May 20 16:17:09.172122 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.1131699
May 20 16:17:09.186556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Request body: {'port': {'device_id': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:09.258857 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe57b59-d27e-455d-af16-46598668e1cf req-aab7012c-597c-46c0-8a60-a943108f47ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:09.260647 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0fe57b59-d27e-455d-af16-46598668e1cf req-aab7012c-597c-46c0-8a60-a943108f47ad service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.1381350
May 20 16:17:09.283140 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ccacbaaf-1b21-4ad9-8067-d759a5c8d3d2 req-b4929639-b72c-491d-b71f-d653e940d72a service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2891695
May 20 16:17:09.366131 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:09.372722 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0fe57b59-d27e-455d-af16-46598668e1cf req-86f0d382-11a8-4bb1-831c-5b9bd7213628 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0930762
May 20 16:17:09.383573 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:09.513281 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-976db6a9-f9ab-4170-80f6-3ccab4c5ef12 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:09.523692 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-29473c36-026e-4703-9609-3ab739fe07eb None None] Provisioning for port 4c1d2c1d-f53f-4921-822b-db24d856090e completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:17:09.529815 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-29473c36-026e-4703-9609-3ab739fe07eb None None] Provisioning complete for port 4c1d2c1d-f53f-4921-822b-db24d856090e triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:17:09.531041 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-29473c36-026e-4703-9609-3ab739fe07eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:09.573497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=96f449ed-0a00-4b3c-9966-9a45d066947f,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:09.580085 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:09.588134 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:09.641582 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-29473c36-026e-4703-9609-3ab739fe07eb None None] Port 4c1d2c1d-f53f-4921-822b-db24d856090e cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:17:09.675176 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-05dc72eb-d09d-449b-bdc7-ef1ed3de10ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:09.676721 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-05dc72eb-d09d-449b-bdc7-ef1ed3de10ab service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 1097 time: 0.2633133
May 20 16:17:09.723630 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] 10.222.0.64 "DELETE /v2.0/subnets/96f449ed-0a00-4b3c-9966-9a45d066947f HTTP/1.1" status: 204  len: 168 time: 1.7705200
May 20 16:17:09.725097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56866) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:09.896850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a1a236-0026-4945-b757-7f84dc084f59 req-90759059-b68e-4313-ad07-eecaaea3b947 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:09.898334 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c0a1a236-0026-4945-b757-7f84dc084f59 req-90759059-b68e-4313-ad07-eecaaea3b947 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 944 time: 0.5630867
May 20 16:17:09.913613 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0fe57b59-d27e-455d-af16-46598668e1cf req-58fc4ed1-6ae4-46bc-a6c1-0506d263bfd5 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5314302
May 20 16:17:09.967462 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.011134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-8038a730-d54b-4f5c-9273-29b75bc1becd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:10.012629 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-8038a730-d54b-4f5c-9273-29b75bc1becd service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.3288524
May 20 16:17:10.013408 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-698e69e2-cd96-4ea0-9401-4adcd946ec94 req-f9844cc9-4192-4d15-be72-f9bac7dcbba5 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:10.016024 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-698e69e2-cd96-4ea0-9401-4adcd946ec94 req-f9844cc9-4192-4d15-be72-f9bac7dcbba5 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.3497477
May 20 16:17:10.026946 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c0a1a236-0026-4945-b757-7f84dc084f59 req-51465ecf-57c6-42f1-ab6a-76dcdda3f91a tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1156409
May 20 16:17:10.089073 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-2e552c88-8321-4b71-9c67-8634c79184aa service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=12e95041-05fa-4910-ada4-e349ed594896 HTTP/1.1" status: 200  len: 217 time: 0.0679035
May 20 16:17:10.241142 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4c1d2c1d-f53f-4921-822b-db24d856090e {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:10.246442 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-97e64e48-d3ed-4cfd-8a3d-a530eef32983 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:10.249821 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-97e64e48-d3ed-4cfd-8a3d-a530eef32983 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.1514561
May 20 16:17:10.252001 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.299253 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-698e69e2-cd96-4ea0-9401-4adcd946ec94 req-095e4f11-81ec-442a-bda4-a3f596c785fa tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2244320
May 20 16:17:10.312775 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-3321ac3a-0f0e-4c49-a6c7-4804e59f652f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0528867
May 20 16:17:10.316294 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Transition to ACTIVE for port object 4c1d2c1d-f53f-4921-822b-db24d856090e will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:17:10.358490 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0fe57b59-d27e-455d-af16-46598668e1cf req-5345d069-2816-4174-a818-12bb24f3aba2 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4228714
May 20 16:17:10.366987 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.385997 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fe711c2de50>> segment before_delete 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.386470 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fe711c2de50>> subnet precommit_delete_associations 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> segment_host_mapping after_create 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> port after_create 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> port after_delete 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> port after_update 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> segment after_delete 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> subnet after_create 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> subnet after_delete 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.392760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe711c2d7c0>> subnet after_update 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.428754 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.439589 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:10.522566 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 0ea6d03c-015e-4b25-bea8-4db73fba158e details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:17:10.563206 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711ac3790>> subnet after_create 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.564875 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711ac3790>> subnet after_delete 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.565219 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711ac3790>> subnet before_create 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.565559 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711ac3790>> subnet before_update 55550000 {{(pid=92421) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:10.568914 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe711c2dd90>,) {'filters': {'network_id': ['597c1087-197a-4c41-acd4-22ded3976be3']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:10.647206 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711c2dd90>, 'fbb0e2c9-867a-43b3-a337-cba9bc64a01c') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:10.647556 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711c2dd90>, 'fbb0e2c9-867a-43b3-a337-cba9bc64a01c') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:10.653094 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:10.659200 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-bb907f39-6c4a-4497-8b2e-41a7a4d9f486 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3414931
May 20 16:17:10.664839 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:10.684965 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 0ea6d03c-015e-4b25-bea8-4db73fba158e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=0ea6d03c-015e-4b25-bea8-4db73fba158e,segment=NetworkSegment(6693d38d-3373-4cfe-8791-6de4025dd8b2),segment_id=6693d38d-3373-4cfe-8791-6de4025dd8b2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:10.693112 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Attempting to bind port 4c1d2c1d-f53f-4921-822b-db24d856090e on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:17:10.695481 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Attempting to bind port 4c1d2c1d-f53f-4921-822b-db24d856090e by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:17:10.695481 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Attempting to bind port 4c1d2c1d-f53f-4921-822b-db24d856090e on network 77fd2be7-62d4-4a17-a108-9198b949900a {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:10.700595 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.703170 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '0ea6d03c-015e-4b25-bea8-4db73fba158e', 'network_id': '679d7722-330c-49b6-b5b8-e851267c2357', 'port_id': '0ea6d03c-015e-4b25-bea8-4db73fba158e', 'mac_address': 'fa:16:3e:61:9f:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 643, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62bb207d-d1f6-4694-870b-d608e6900fa3', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:17:10.716644 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Port 4c1d2c1d-f53f-4921-822b-db24d856090e on network 77fd2be7-62d4-4a17-a108-9198b949900a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:17:10.717069 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Attempting to bind port 4c1d2c1d-f53f-4921-822b-db24d856090e on network 77fd2be7-62d4-4a17-a108-9198b949900a {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:10.728934 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 16, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:17:10.729347 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Checking segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:17:10.729800 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Bound using segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:17:10.730306 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Bound port: 4c1d2c1d-f53f-4921-822b-db24d856090e, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:17:10.731043 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.744538 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.759095 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a1b288-b31e-4e1d-94ae-e8c7d724dd53 req-d049d4f7-c1be-4692-91c4-9b6f59046a06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:10.761390 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d3a1b288-b31e-4e1d-94ae-e8c7d724dd53 req-d049d4f7-c1be-4692-91c4-9b6f59046a06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 931 time: 0.5583060
May 20 16:17:10.766781 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Releasing vlan 627 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:17:10.767215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   from cryptography.utils import int_from_bytes
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   from cryptography.utils import int_from_bytes
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:17:10.784397 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:17:10.853498 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:10.878056 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0ea6d03c-015e-4b25-bea8-4db73fba158e {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:10.904351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 0ea6d03c-015e-4b25-bea8-4db73fba158e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=0ea6d03c-015e-4b25-bea8-4db73fba158e,segment=NetworkSegment(6693d38d-3373-4cfe-8791-6de4025dd8b2),segment_id=6693d38d-3373-4cfe-8791-6de4025dd8b2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:10.918357 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb65d9a-39a3-4543-aae0-929a7ba1719c req-8561d3e7-8dd0-4005-8e32-c5634148c528 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:10.919833 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0bb65d9a-39a3-4543-aae0-929a7ba1719c req-8561d3e7-8dd0-4005-8e32-c5634148c528 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 944 time: 0.3255143
May 20 16:17:10.925402 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e34029f7-2b13-415a-a1df-a872b0fe0f01 req-0aa4d99e-e56f-44ee-813e-ba9d6201180c service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2575686
May 20 16:17:10.931809 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d3a1b288-b31e-4e1d-94ae-e8c7d724dd53 req-fe2ea616-6661-4105-b1d8-7b6e6c2fe082 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1463058
May 20 16:17:10.955214 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:17:10.960148 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:17:10.987366 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0bb65d9a-39a3-4543-aae0-929a7ba1719c req-0967b465-0ac8-44cf-a5b9-3f1f3446adde tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0543940
May 20 16:17:11.003806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.003994 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.004656 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4b373943-e984-4276-9601-6ed0d000265f details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:17:11.006841 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:11.009493 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:11.024970 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.034962 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Pushing event deleted for resources: {'Network': ['ID=597c1087-197a-4c41-acd4-22ded3976be3,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:11.037909 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:11.042468 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] 10.222.0.64 "DELETE /v2.0/networks/597c1087-197a-4c41-acd4-22ded3976be3 HTTP/1.1" status: 204  len: 168 time: 1.3004832
May 20 16:17:11.042751 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 56900) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:11.073278 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.079879 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:11.120267 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=0ea6d03c-015e-4b25-bea8-4db73fba158e,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:11.122622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Deleting subnet 852ef265-25a6-4d3a-a921-bc6e998c70b8 {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:17:11.134073 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:11.139161 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.178380 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:11.179043 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.180472 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] 10.222.0.16 "PUT /v2.0/ports/4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 1093 time: 2.0005972
May 20 16:17:11.180943 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:11.229585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:11.235505 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:11.320618 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.380392 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'status': 'completed', 'code': 200}
May 20 16:17:11.397663 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4b373943-e984-4276-9601-6ed0d000265f, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4b373943-e984-4276-9601-6ed0d000265f,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:11.407634 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93896c5-b144-41d3-9157-5388fa8a923a req-7b5e7327-3a47-4b32-8a7a-ca6cde89df8c tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:11.419132 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '4b373943-e984-4276-9601-6ed0d000265f', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'port_id': '4b373943-e984-4276-9601-6ed0d000265f', 'mac_address': 'fa:16:3e:c3:8a:56', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 608, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '924a520e-53e5-4777-beb9-f9e6d0bd0dff', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:17:11.419633 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d93896c5-b144-41d3-9157-5388fa8a923a req-7b5e7327-3a47-4b32-8a7a-ca6cde89df8c tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 945 time: 0.2233248
May 20 16:17:11.446772 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-62422663-02a1-49e1-b2db-f6982f3bf531 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:11.448368 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-62422663-02a1-49e1-b2db-f6982f3bf531 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1096 time: 0.1641071
May 20 16:17:11.524079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.559939 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.565624 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d93896c5-b144-41d3-9157-5388fa8a923a req-530432fc-f960-465c-b2ce-52744e7f21e1 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1450319
May 20 16:17:11.594494 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b373943-e984-4276-9601-6ed0d000265f {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:11.597578 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-3d82af23-f9f0-4afc-a0e5-10a2b5f0fe09 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 217 time: 0.1408818
May 20 16:17:11.615600 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4b373943-e984-4276-9601-6ed0d000265f, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4b373943-e984-4276-9601-6ed0d000265f,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:11.665759 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-aac09ef8-97fa-4696-9af3-a356f9580817 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:11.667364 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-aac09ef8-97fa-4696-9af3-a356f9580817 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0630896
May 20 16:17:11.706252 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:11.709403 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-52af5d36-e592-4c7b-b3de-ae7d5d8617c7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:11.752929 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-dcbe73cc-5927-45df-945a-9e497742844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:11.754465 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-dcbe73cc-5927-45df-945a-9e497742844e service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0803237
May 20 16:17:11.808920 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4b373943-e984-4276-9601-6ed0d000265f,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:11.815416 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b48cd-771f-48e4-b587-456d343ac2d7 req-d8970ef4-56db-4594-8ccf-74c65d67946c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:11.815546 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:11.817258 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9d6b48cd-771f-48e4-b587-456d343ac2d7 req-d8970ef4-56db-4594-8ccf-74c65d67946c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 944 time: 0.3581126
May 20 16:17:11.922221 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-77c32dc6-1e74-4ca6-9ab8-63ec2db96bfe service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1585605
May 20 16:17:11.932832 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9d6b48cd-771f-48e4-b587-456d343ac2d7 req-472d6795-4cfb-44a5-82aa-ab7ad2754a70 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0986340
May 20 16:17:12.097461 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.110440 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:12.137642 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['0ea6d03c-015e-4b25-bea8-4db73fba158e'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:17:12.162116 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a8f6d4fe-3e74-4bfe-970a-75b3dd3c3372 req-53c9383f-47f1-44bf-b7d2-11fd44f21e08 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2331829
May 20 16:17:12.191148 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:17:12.197205 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=852ef265-25a6-4d3a-a921-bc6e998c70b8,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:12.200367 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.209250 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:12.222058 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] 10.222.0.64 "DELETE /v2.0/subnets/852ef265-25a6-4d3a-a921-bc6e998c70b8 HTTP/1.1" status: 204  len: 168 time: 1.1783369
May 20 16:17:12.225172 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56924) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:12.255333 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f16fe12-3d8e-494f-93ee-f0ff38d801ff req-c3b55e4a-54ac-4603-adee-e262e91afa16 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:12.257588 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f16fe12-3d8e-494f-93ee-f0ff38d801ff req-c3b55e4a-54ac-4603-adee-e262e91afa16 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1997638
May 20 16:17:12.275083 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18b1561a-a1d9-4de3-896c-8d905abd179d req-1cdeb27c-814f-4c2e-ad71-f34a5a9d62d1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:12.275083 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-18b1561a-a1d9-4de3-896c-8d905abd179d req-1cdeb27c-814f-4c2e-ad71-f34a5a9d62d1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 944 time: 0.1640196
May 20 16:17:12.361981 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f16fe12-3d8e-494f-93ee-f0ff38d801ff req-3fc5a687-52b9-470a-97bd-c09f469f532c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0874422
May 20 16:17:12.372548 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-18b1561a-a1d9-4de3-896c-8d905abd179d req-797743d2-6826-4087-8472-7ec038e9574e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0819573
May 20 16:17:12.438301 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.509745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:17:12.533299 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-baa7d46f-0c0f-47aa-af29-4719304890ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:12.534901 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-baa7d46f-0c0f-47aa-af29-4719304890ab service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1096 time: 0.2364593
May 20 16:17:12.614731 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.652018 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fe711fdd310>> segment before_delete 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.652400 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fe711fdd310>> subnet precommit_delete_associations 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.653128 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> segment_host_mapping after_create 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.653510 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> port after_create 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.653863 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> port after_delete 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.654214 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> port after_update 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.654531 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> segment after_delete 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.654896 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> subnet after_create 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.655241 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> subnet after_delete 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.655568 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe71203d760>> subnet after_update 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.730037 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711fca2e0>> subnet after_create 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.730391 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711fca2e0>> subnet after_delete 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.730777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711fca2e0>> subnet before_create 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.731110 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe711fca2e0>> subnet before_update 55550000 {{(pid=92422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 16:17:12.731519 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe71203da60>,) {'filters': {'network_id': ['56b7493d-1ccd-43e8-a5c2-064e49437d96']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:12.789873 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:12.794542 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71203da60>, '257639ed-ca9e-49a4-813f-fa685b0954b8') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:12.794838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71203da60>, '257639ed-ca9e-49a4-813f-fa685b0954b8') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:12.809588 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0', 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'port_id': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0', 'mac_address': 'fa:16:3e:67:09:ab', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 622, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:17:12.817691 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.847808 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.848912 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e94ed67-2222-4bfb-99a4-69071fceca4c req-814b4721-9ebf-410b-8309-45c668014b5a tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:12.851698 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9e94ed67-2222-4bfb-99a4-69071fceca4c req-814b4721-9ebf-410b-8309-45c668014b5a tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 945 time: 0.1319053
May 20 16:17:12.868777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Releasing vlan 621 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:17:12.869101 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.872133 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   from cryptography.utils import int_from_bytes
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   from cryptography.utils import int_from_bytes
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:17:12.885065 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:17:12.892418 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:12.903365 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9e94ed67-2222-4bfb-99a4-69071fceca4c req-f6089a50-2cc3-4a6f-bce5-7e9e37e8919e tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469658
May 20 16:17:12.911018 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-6473a16f-2208-4933-bf94-9d7dc5c12bf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:12.911205 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:12.912692 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-6473a16f-2208-4933-bf94-9d7dc5c12bf9 service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.3311901
May 20 16:17:13.004703 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:13.005910 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 12e95041-05fa-4910-ada4-e349ed594896 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:17:13.018608 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:13.030537 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-e6417ff4-292c-482d-8011-fc06c314d68a service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 217 time: 0.0747120
May 20 16:17:13.104044 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-287f28de-5732-4cf8-83b8-a700684cc4a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:13.105908 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-287f28de-5732-4cf8-83b8-a700684cc4a6 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0681450
May 20 16:17:13.115865 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 12e95041-05fa-4910-ada4-e349ed594896, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=12e95041-05fa-4910-ada4-e349ed594896,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:13.126008 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:13.143095 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:13.150843 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '12e95041-05fa-4910-ada4-e349ed594896', 'network_id': '6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4', 'port_id': '12e95041-05fa-4910-ada4-e349ed594896', 'mac_address': 'fa:16:3e:fd:e2:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 622, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6f615bc-43ff-44ce-82a2-e2cbda58ee9e', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:17:13.153441 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ab4622-6de6-4cb4-ad4b-c8d1270da503 req-e60211fb-7847-4fb1-b58a-5817ddc23d76 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:13.157068 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-63ab4622-6de6-4cb4-ad4b-c8d1270da503 req-e60211fb-7847-4fb1-b58a-5817ddc23d76 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 945 time: 0.1005602
May 20 16:17:13.159917 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:13.174860 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:13.189587 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:13.201194 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Pushing event deleted for resources: {'Network': ['ID=56b7493d-1ccd-43e8-a5c2-064e49437d96,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:13.205169 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:13.210867 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] 10.222.0.64 "DELETE /v2.0/networks/56b7493d-1ccd-43e8-a5c2-064e49437d96 HTTP/1.1" status: 204  len: 168 time: 0.9820516
May 20 16:17:13.237740 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-63ab4622-6de6-4cb4-ad4b-c8d1270da503 req-9d89c261-857a-45be-9ce4-8b0c9b737229 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0713463
May 20 16:17:13.242940 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-2472f3fa-4821-441b-b67e-ea69b00c252f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:13.245914 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-2472f3fa-4821-441b-b67e-ea69b00c252f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1324904
May 20 16:17:13.301087 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:13.318240 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 12e95041-05fa-4910-ada4-e349ed594896 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:13.334835 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 12e95041-05fa-4910-ada4-e349ed594896, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=12e95041-05fa-4910-ada4-e349ed594896,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:13.395780 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-c50fbd01-42ec-4ed3-8b11-f7d4306b486a service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1409926
May 20 16:17:13.477698 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:13.481445 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:13.551731 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5bd4c335-f647-480d-ada8-a16172b597f4 req-873ffc0e-4cd3-4877-a255-c45911c4b8f5 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1495519
May 20 16:17:13.565361 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=12e95041-05fa-4910-ada4-e349ed594896,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:13.569247 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:13.629420 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1105d55-fc7a-4816-9b24-a7363208b2a6 req-e79f1d28-f78c-44a7-a541-990f44bd03c7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:13.630934 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1105d55-fc7a-4816-9b24-a7363208b2a6 req-e79f1d28-f78c-44a7-a541-990f44bd03c7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 945 time: 0.1563427
May 20 16:17:13.640399 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36dc3c1-9335-4d93-962d-3b5ccfc6117c req-d10de2fd-be58-4277-8bba-797837af7568 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:13.641787 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d36dc3c1-9335-4d93-962d-3b5ccfc6117c req-d10de2fd-be58-4277-8bba-797837af7568 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1278057
May 20 16:17:13.682538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56960) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:13.713471 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1105d55-fc7a-4816-9b24-a7363208b2a6 req-35244c00-ed3d-44ca-8dd1-74750e00808b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0706775
May 20 16:17:13.719775 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d36dc3c1-9335-4d93-962d-3b5ccfc6117c req-69d179ff-bb1e-4da1-9941-6251954ca627 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0622284
May 20 16:17:13.753055 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2a23bd13-9b9e-489f-9c02-d07587ccf5c0 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=f5739e05b86f4951acde901fb4b8cfc0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0690417
May 20 16:17:13.766577 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 56966) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:13.832940 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:13.866054 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.011836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['12e95041-05fa-4910-ada4-e349ed594896'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:17:14.037773 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.043107 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:14.045337 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:17:14.059229 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d41beefd-97c7-49ec-a915-0183d4f0d002,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:14.062379 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:14.067885 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.069649 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d41beefd-97c7-49ec-a915-0183d4f0d002 HTTP/1.1" status: 204  len: 168 time: 0.3010063
May 20 16:17:14.147669 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf2d37bb-05c2-47d6-aed7-609ff1ac9a9d req-79e95651-fa7b-4afc-a562-564a31a140e6 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:14.149807 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf2d37bb-05c2-47d6-aed7-609ff1ac9a9d req-79e95651-fa7b-4afc-a562-564a31a140e6 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 945 time: 0.1231289
May 20 16:17:14.204733 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf2d37bb-05c2-47d6-aed7-609ff1ac9a9d req-0bc9afde-0383-485e-8672-69e48f9fbf15 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484228
May 20 16:17:14.467035 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-175c2e87-06ec-4764-8fa5-ea3b5f2b2303 req-4c55ee4a-2de7-4fab-8f18-4427854a4dc1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:14.469418 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-175c2e87-06ec-4764-8fa5-ea3b5f2b2303 req-4c55ee4a-2de7-4fab-8f18-4427854a4dc1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 945 time: 0.0898390
May 20 16:17:14.523066 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-175c2e87-06ec-4764-8fa5-ea3b5f2b2303 req-3dad4999-8412-40f8-a825-9c8a561f4996 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458207
May 20 16:17:14.545112 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 0ea6d03c-015e-4b25-bea8-4db73fba158e up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:17:14.569036 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57002) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:14.695908 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.711488 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:14.715407 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Usage tracker for resource:security_group_rule and tenant:00057ff522a24ba9adf4011dc533b56d is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:14.718872 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:14.723304 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 0ea6d03c-015e-4b25-bea8-4db73fba158e completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:17:14.724814 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:14.728154 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 0ea6d03c-015e-4b25-bea8-4db73fba158e triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:17:14.732320 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.828166 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.889777 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.899551 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57016) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:14.918561 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2103aba6-9c9a-4eef-a289-d656208928fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ea6d03c-015e-4b25-bea8-4db73fba158e'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:14.944894 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:14.952270 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-078d959b-3a31-48fd-8986-74339defcd2b admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=41051fd136554568893086f02d058b53&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0509279
May 20 16:17:14.954799 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57020) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:14.977270 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:14.991022 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 0ea6d03c-015e-4b25-bea8-4db73fba158e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=0ea6d03c-015e-4b25-bea8-4db73fba158e,segment=NetworkSegment(6693d38d-3373-4cfe-8791-6de4025dd8b2),segment_id=6693d38d-3373-4cfe-8791-6de4025dd8b2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:15.024773 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=006c0540-8079-4fc4-8cdc-34ac00310a54,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:15.032791 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:15.044622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558cbe62-5f29-4b35-ad0a-b64a95e98b71 req-21ea9a26-5080-44a9-97cb-1cf88e04754c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:15.048943 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.051640 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-558cbe62-5f29-4b35-ad0a-b64a95e98b71 req-21ea9a26-5080-44a9-97cb-1cf88e04754c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 945 time: 0.1782870
May 20 16:17:15.078744 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=00057ff522a24ba9adf4011dc533b56d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5080817
May 20 16:17:15.082987 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57030) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:15.088901 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.118024 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.119758 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4b373943-e984-4276-9601-6ed0d000265f up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:17:15.126677 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b72eeea-a982-4e4b-bc8a-1fe45e824a56 req-59f0079a-da4f-44fb-bfe8-8f6d10b38164 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:15.128402 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b72eeea-a982-4e4b-bc8a-1fe45e824a56 req-59f0079a-da4f-44fb-bfe8-8f6d10b38164 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.2872941
May 20 16:17:15.141620 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-558cbe62-5f29-4b35-ad0a-b64a95e98b71 req-fc029fb3-f577-48d9-b274-5e8947107d4c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0890155
May 20 16:17:15.165780 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:15.238369 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b72eeea-a982-4e4b-bc8a-1fe45e824a56 req-65cb4255-738e-4af8-80ee-90b822cd50e7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0956161
May 20 16:17:15.260391 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.301118 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.301384 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=0ea6d03c-015e-4b25-bea8-4db73fba158e,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:15.307467 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:15.309408 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.314004 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ac2d516-baa5-41e1-b137-53d35a88b87d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:15.331353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d58ded97-f485-46fd-bee3-db178651caaa,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:15.351585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:15.352577 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.353741 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d58ded97-f485-46fd-bee3-db178651caaa HTTP/1.1" status: 204  len: 168 time: 0.3978326
May 20 16:17:15.375027 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2103aba6-9c9a-4eef-a289-d656208928fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ea6d03c-015e-4b25-bea8-4db73fba158e', 'code': 200}
May 20 16:17:15.380816 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 4b373943-e984-4276-9601-6ed0d000265f completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:17:15.401195 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 4b373943-e984-4276-9601-6ed0d000265f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:17:15.401817 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.507072 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.518406 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:15.533718 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=006c0540-8079-4fc4-8cdc-34ac00310a54,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:15.538614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:15.543067 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.547487 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/006c0540-8079-4fc4-8cdc-34ac00310a54 HTTP/1.1" status: 204  len: 168 time: 0.4593577
May 20 16:17:15.548869 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.566693 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e362a497-087d-4e04-84c8-046389591e14 req-c4de5295-8d35-4786-bd8d-f7cc1cec6af3 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:15.568254 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e362a497-087d-4e04-84c8-046389591e14 req-c4de5295-8d35-4786-bd8d-f7cc1cec6af3 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.1319556
May 20 16:17:15.587332 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4b373943-e984-4276-9601-6ed0d000265f, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4b373943-e984-4276-9601-6ed0d000265f,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:15.636172 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e362a497-087d-4e04-84c8-046389591e14 req-5a796622-3381-4689-85c2-07fbd0a78ac3 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0560524
May 20 16:17:15.654601 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:15.657034 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-663b91a9-cd1d-4e8d-94d9-0842e90aa203 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:15.731452 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4b373943-e984-4276-9601-6ed0d000265f,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:15.743612 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:15.782525 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b4ee14-6c12-4c9c-8585-daeab878add2 req-19914e3e-2815-4bad-90e8-a93c86ce6392 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:15.782525 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d0b4ee14-6c12-4c9c-8585-daeab878add2 req-19914e3e-2815-4bad-90e8-a93c86ce6392 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.1095276
May 20 16:17:15.850889 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d0b4ee14-6c12-4c9c-8585-daeab878add2 req-3d2b5489-a341-45cb-b276-19a0c38c45ed tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0593715
May 20 16:17:15.894706 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-af082328-e590-4b46-9eb2-0cc8ce75df70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:16.001763 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-ba554dde-2204-40ac-967b-c76c3001dfab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:16.003432 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-ba554dde-2204-40ac-967b-c76c3001dfab service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 1099 time: 0.2167315
May 20 16:17:16.032857 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:16.054718 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:16.055012 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Usage tracker for resource:security_group_rule and tenant:571ccf58d8ca41d5997781f43472b617 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:16.057769 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:16.063926 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:16.148764 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:16.238028 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:16.247777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-faf6399f-ca4e-40b6-8bcf-8ad83bb03d65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:16.328893 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=96b0a951-4e71-41aa-951b-645ae849a59d,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:16.335760 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-71c2b709-3df5-45c5-8333-e35a9450d83e req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3242605
May 20 16:17:16.336576 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:16.375557 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c341be0-59d5-4659-acbf-568f2b760633 req-8c78918d-8e0e-48c3-802f-e2918103c12a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:16.377024 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c341be0-59d5-4659-acbf-568f2b760633 req-8c78918d-8e0e-48c3-802f-e2918103c12a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 945 time: 0.1134489
May 20 16:17:16.538359 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c341be0-59d5-4659-acbf-568f2b760633 req-47b3cab0-1610-4b66-90fc-072b2735b7a1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1527994
May 20 16:17:16.555016 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:17:16.559456 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d03f06e-9383-468c-af53-72042b81acec req-6354b631-9a96-414b-b82b-dd789f71e6aa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:16.570219 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d03f06e-9383-468c-af53-72042b81acec req-6354b631-9a96-414b-b82b-dd789f71e6aa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1063290
May 20 16:17:16.606577 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:17:16.612647 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d03f06e-9383-468c-af53-72042b81acec req-ee16f0ea-b7c0-4139-99f3-9127961e02ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426831
May 20 16:17:16.788918 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:16.806012 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'port_id': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'mac_address': 'fa:16:3e:eb:92:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:17:16.846561 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a98786-5f6a-484f-8361-6868b4cb0304 req-f4451150-63e2-4fdc-a735-0138b34eb47d tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:16.848659 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f0a98786-5f6a-484f-8361-6868b4cb0304 req-f4451150-63e2-4fdc-a735-0138b34eb47d tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.0885093
May 20 16:17:16.877476 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:16.896011 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:17:16.906210 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:17:16.906589 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:16.908178 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f0a98786-5f6a-484f-8361-6868b4cb0304 req-355eab3c-4501-4942-acef-4da0c73fb201 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0539987
May 20 16:17:16.954196 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c1d2c1d-f53f-4921-822b-db24d856090e {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:16.988078 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:17.083301 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:17.087850 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:17.147839 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:17.152053 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df8ba56-7e30-45e4-ad92-437d163e4ce7 req-6bee62f1-2791-4f35-be83-986c257edbe1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:17.153665 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9df8ba56-7e30-45e4-ad92-437d163e4ce7 req-6bee62f1-2791-4f35-be83-986c257edbe1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.1294763
May 20 16:17:17.191064 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:17.195415 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:17.200369 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:17.212701 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9df8ba56-7e30-45e4-ad92-437d163e4ce7 req-6f07ba31-0cb3-4ba1-af62-e9ef8415429c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0511608
May 20 16:17:17.306553 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:17.307516 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 12e95041-05fa-4910-ada4-e349ed594896 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:17:17.339486 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:17.379732 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b373943-e984-4276-9601-6ed0d000265f'}, {'server_uuid': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:17.434876 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:17.438125 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:17.441681 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b373943-e984-4276-9601-6ed0d000265f', 'code': 200}
May 20 16:17:17.441955 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0', 'code': 200}
May 20 16:17:17.454289 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4c1d2c1d-f53f-4921-822b-db24d856090e'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:17:17.529570 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 12e95041-05fa-4910-ada4-e349ed594896 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:17:17.545328 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 12e95041-05fa-4910-ada4-e349ed594896 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:17:17.546151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:17.777943 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:17.845654 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 12e95041-05fa-4910-ada4-e349ed594896, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=12e95041-05fa-4910-ada4-e349ed594896,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:17.917469 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:17.919388 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:17.973319 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18c08d7-bb4a-4012-86f8-8b9fee253002 req-6d452146-83e8-4b7e-84d7-f3649ef59f4c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:17.975324 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e18c08d7-bb4a-4012-86f8-8b9fee253002 req-6d452146-83e8-4b7e-84d7-f3649ef59f4c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 944 time: 0.1426125
May 20 16:17:17.986369 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4a3851-9941-4da9-b1f3-270b0ce01651 req-d7095ca7-87e8-4e21-b4e3-25de7b8190b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:17.987904 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ca4a3851-9941-4da9-b1f3-270b0ce01651 req-d7095ca7-87e8-4e21-b4e3-25de7b8190b7 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.1510081
May 20 16:17:18.011443 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40551bc-2041-4ee8-a6d8-539c3b443c64 req-693f818e-f095-4310-a6da-0ef38c668c08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:18.013316 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a40551bc-2041-4ee8-a6d8-539c3b443c64 req-693f818e-f095-4310-a6da-0ef38c668c08 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 1099 time: 0.1253095
May 20 16:17:18.018453 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f7beee-c122-43d1-8daa-3c32cd394604 req-58771a9d-13bc-4abd-8108-d4ff41bd608d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:18.027539 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-14f7beee-c122-43d1-8daa-3c32cd394604 req-58771a9d-13bc-4abd-8108-d4ff41bd608d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 945 time: 0.2984447
May 20 16:17:18.045318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57172) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:18.075079 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ca4a3851-9941-4da9-b1f3-270b0ce01651 req-dfce76a8-a209-46e4-a8eb-4cf8bec6dc60 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0799623
May 20 16:17:18.076182 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=12e95041-05fa-4910-ada4-e349ed594896,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:18.084432 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a40551bc-2041-4ee8-a6d8-539c3b443c64 req-dc86f263-01a9-4486-978a-b3473918e533 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0642788
May 20 16:17:18.086130 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:18.115537 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e18c08d7-bb4a-4012-86f8-8b9fee253002 req-9f837664-440d-41ca-a51e-9612fc53f596 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1131566
May 20 16:17:18.115537 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-14f7beee-c122-43d1-8daa-3c32cd394604 req-1c257fa0-06c1-4439-b2c0-f269dcf8a229 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0856121
May 20 16:17:18.409010 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.414992 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9775401c-dab4-4a37-82f9-ba1cbbf47b45 req-f8d58c9e-1e96-47b2-8b7f-2c742724e355 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:18.416549 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9775401c-dab4-4a37-82f9-ba1cbbf47b45 req-f8d58c9e-1e96-47b2-8b7f-2c742724e355 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.1811292
May 20 16:17:18.417423 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.433074 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:18.437883 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Usage tracker for resource:security_group_rule and tenant:555def56c56c450db575d39706f08b55 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:18.440752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:18.446877 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:18.543143 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9775401c-dab4-4a37-82f9-ba1cbbf47b45 req-a34dcf4e-27ab-4a2b-8d4a-17d707e68ff3 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1159279
May 20 16:17:18.589412 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.598702 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f21817c-25d3-4c0b-acf7-f57b5b8d1015 req-feb0afc3-5cf7-4c55-8e30-0c4f29869872 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:18.600132 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3f21817c-25d3-4c0b-acf7-f57b5b8d1015 req-feb0afc3-5cf7-4c55-8e30-0c4f29869872 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.1349971
May 20 16:17:18.626691 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-282f0c31-d925-4d09-b7dc-e7cb5a92afd5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.657695 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3f21817c-25d3-4c0b-acf7-f57b5b8d1015 req-807c26b0-0843-4f61-af53-3608daeb3b88 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515938
May 20 16:17:18.683932 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.694569 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:18.736579 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=555def56c56c450db575d39706f08b55&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6856625
May 20 16:17:18.737701 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ace80e8-991e-4b97-9739-ecd54b8a9190,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:18.739288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57200) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:18.750396 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:18.804052 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.832222 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.969727 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.974787 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-6697d818-30de-42c1-b4d6-cc5f59dfd8f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:18.988240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ace80e8-991e-4b97-9739-ecd54b8a9190,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:18.990672 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:18.992887 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:18.994236 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/6ace80e8-991e-4b97-9739-ecd54b8a9190 HTTP/1.1" status: 204  len: 168 time: 0.2539823
May 20 16:17:19.412972 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d820664b-92d6-4fc5-a5a3-e97387680a1f req-c45bbf95-956c-4aac-98e3-c772a0967863 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:19.414500 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d820664b-92d6-4fc5-a5a3-e97387680a1f req-c45bbf95-956c-4aac-98e3-c772a0967863 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 944 time: 0.1240177
May 20 16:17:19.423600 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60436352-814f-4b49-a4fe-2f7aa146d119 req-f5cc71b5-842b-4eb2-8488-3bcf4360baf7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:19.425101 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60436352-814f-4b49-a4fe-2f7aa146d119 req-f5cc71b5-842b-4eb2-8488-3bcf4360baf7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1669955
May 20 16:17:19.443220 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '12e95041-05fa-4910-ada4-e349ed594896'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:19.501006 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d820664b-92d6-4fc5-a5a3-e97387680a1f req-9b4e686a-f77e-41be-b396-d88bcb05d973 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0749154
May 20 16:17:19.511489 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60436352-814f-4b49-a4fe-2f7aa146d119 req-8911a7c2-3bf9-48c0-86f5-6d16eccad8e9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0597682
May 20 16:17:19.581789 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '12e95041-05fa-4910-ada4-e349ed594896', 'code': 200}
May 20 16:17:19.643022 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:19.734330 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57230) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:19.754400 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:19.786930 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:19.793630 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Usage tracker for resource:security_group_rule and tenant:72dbe8db36254a138045bcb2d98e8091 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:19.797901 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:19.800227 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c37c09c-2093-44e7-8a87-2a0801e28d35 req-48fd5d6c-3de9-47ad-801d-574125a0de17 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:19.802016 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4c37c09c-2093-44e7-8a87-2a0801e28d35 req-48fd5d6c-3de9-47ad-801d-574125a0de17 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.1224005
May 20 16:17:19.805825 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:19.919674 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:19.922920 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4c37c09c-2093-44e7-8a87-2a0801e28d35 req-171c85ce-ba0c-4ebc-9d11-e82de456053f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1145289
May 20 16:17:19.955932 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd1b796-0fc5-4a81-93a5-6dbef3bd4767 req-f9b6d637-9583-4bc0-b7d0-11553e5e006e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:19.957214 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8cd1b796-0fc5-4a81-93a5-6dbef3bd4767 req-f9b6d637-9583-4bc0-b7d0-11553e5e006e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.1215105
May 20 16:17:20.003874 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:20.006672 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8cd1b796-0fc5-4a81-93a5-6dbef3bd4767 req-f13f0a72-2e45-40b7-b3fa-9f92168fb39d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434964
May 20 16:17:20.036261 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:20.053709 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=72dbe8db36254a138045bcb2d98e8091&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3174896
May 20 16:17:20.056218 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57238) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:20.079094 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=deed5e75-b202-42c1-b0fa-bd41992a93c9,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:20.084030 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:20.136359 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:20.166097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:20.184552 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b014d2-946f-4092-a69b-11f1bd770c88 req-d91fbbb5-6778-4128-a8d3-484d5c4a7bbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:20.186048 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-83b014d2-946f-4092-a69b-11f1bd770c88 req-d91fbbb5-6778-4128-a8d3-484d5c4a7bbe service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 1099 time: 0.0792749
May 20 16:17:20.229325 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-83b014d2-946f-4092-a69b-11f1bd770c88 req-e7912422-362c-4cd9-a71b-8af9fd0e8b59 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0370622
May 20 16:17:20.313341 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:20.323044 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1e183210-ca41-4aa3-9b79-ea514acfff09 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:20.344616 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=deed5e75-b202-42c1-b0fa-bd41992a93c9,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:20.347684 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:20.351768 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:20.356773 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/deed5e75-b202-42c1-b0fa-bd41992a93c9 HTTP/1.1" status: 204  len: 168 time: 0.2956660
May 20 16:17:20.589017 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:17:20.751945 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 4c1d2c1d-f53f-4921-822b-db24d856090e completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:17:20.757390 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 4c1d2c1d-f53f-4921-822b-db24d856090e triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:17:20.757980 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:20.832131 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34ca800-aff3-44f4-9682-187939ce6cad req-daace4ee-c2c5-4aaa-a051-3a65f5097a19 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:20.834592 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e34ca800-aff3-44f4-9682-187939ce6cad req-daace4ee-c2c5-4aaa-a051-3a65f5097a19 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 944 time: 0.1436615
May 20 16:17:20.843713 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b18e8c0f-a939-4284-a115-156ebe03edfb req-1858fc7d-7101-47b0-8619-5dc4a105501e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:20.847664 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b18e8c0f-a939-4284-a115-156ebe03edfb req-1858fc7d-7101-47b0-8619-5dc4a105501e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1902277
May 20 16:17:20.925250 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:20.956252 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e34ca800-aff3-44f4-9682-187939ce6cad req-725fb948-0dbc-4126-82da-608fd00c6d8d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1053956
May 20 16:17:20.979491 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b18e8c0f-a939-4284-a115-156ebe03edfb req-8ddc6fdb-9dde-425d-80a4-2fbe56a1a052 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1116590
May 20 16:17:21.002074 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:21.171756 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:21.179555 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:21.265902 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c33eefe4-6804-49ff-b1ab-9ac9cbc021f7 req-fff5b690-3182-4220-93ac-5455cc28749a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:21.286917 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c33eefe4-6804-49ff-b1ab-9ac9cbc021f7 req-fff5b690-3182-4220-93ac-5455cc28749a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.1638179
May 20 16:17:21.328513 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:21.336017 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c33eefe4-6804-49ff-b1ab-9ac9cbc021f7 req-1f221b9b-ae8a-48ef-835d-739fa5aee4aa tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480962
May 20 16:17:21.349317 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:21.362289 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:21.582778 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:21.645166 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'code': 200}
May 20 16:17:22.110833 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d19a82-c493-4cd3-9c51-16a8574c3781 req-e9545397-6637-411b-998c-fc8f27b8e753 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:22.112427 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-72d19a82-c493-4cd3-9c51-16a8574c3781 req-e9545397-6637-411b-998c-fc8f27b8e753 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1098 time: 0.1242764
May 20 16:17:22.156349 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-72d19a82-c493-4cd3-9c51-16a8574c3781 req-5d61825e-7b62-4c01-a201-9fb08a559908 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0369952
May 20 16:17:22.357621 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5135e6ed-5d48-4a02-a0cd-fa11ccc53547 req-8253714a-25a3-4e6a-97aa-0eaa319b7e40 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:22.359656 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5135e6ed-5d48-4a02-a0cd-fa11ccc53547 req-8253714a-25a3-4e6a-97aa-0eaa319b7e40 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1984010
May 20 16:17:22.368358 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928caf2f-37f4-4768-b4eb-0b1e420ef488 req-b41dfdca-b0fa-4d03-aea0-f13ce4bcc5d6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:22.369438 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-928caf2f-37f4-4768-b4eb-0b1e420ef488 req-b41dfdca-b0fa-4d03-aea0-f13ce4bcc5d6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.2061450
May 20 16:17:22.440644 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5135e6ed-5d48-4a02-a0cd-fa11ccc53547 req-5d8fc675-c602-4b3d-831d-dcf81f575cd9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0702245
May 20 16:17:22.448115 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-928caf2f-37f4-4768-b4eb-0b1e420ef488 req-27df69c8-fee3-43bc-8003-96a49076f21d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0638950
May 20 16:17:23.216046 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-f28c6b0f-0c9b-4221-9d03-6523d20b9d54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:23.216945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2306ce7f-b728-4a2b-af4e-0654cdf761b2 req-d2ab0a9d-e993-469a-8b54-55c4d937af27 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:23.219090 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-f28c6b0f-0c9b-4221-9d03-6523d20b9d54 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 1099 time: 0.0999660
May 20 16:17:23.219224 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2306ce7f-b728-4a2b-af4e-0654cdf761b2 req-d2ab0a9d-e993-469a-8b54-55c4d937af27 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1310570
May 20 16:17:23.300433 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2306ce7f-b728-4a2b-af4e-0654cdf761b2 req-84817766-93e0-46c3-bd08-6a57c4bfd459 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0737965
May 20 16:17:23.444645 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-db4b7a10-cfea-4885-885c-811716f32a0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:23.446193 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-db4b7a10-cfea-4885-885c-811716f32a0b service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.2203894
May 20 16:17:23.531283 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-0f708784-4122-415b-8ec2-e54aa149d094 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=12e95041-05fa-4910-ada4-e349ed594896 HTTP/1.1" status: 200  len: 217 time: 0.0688429
May 20 16:17:23.632290 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-871ec48d-c970-43ec-bb27-0105fb25a7ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:23.633786 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-871ec48d-c970-43ec-bb27-0105fb25a7ce service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0674295
May 20 16:17:23.688453 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85105c0b-ad84-4856-8790-d4834462867c req-48f9da37-050d-42a8-8a5b-726feaf5f0d9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:23.689666 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-85105c0b-ad84-4856-8790-d4834462867c req-48f9da37-050d-42a8-8a5b-726feaf5f0d9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.0924647
May 20 16:17:23.691781 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-d583080a-1f82-4eea-8b48-aa9d62584f21 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0510159
May 20 16:17:23.742683 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-85105c0b-ad84-4856-8790-d4834462867c req-8dec4f20-5942-443e-9459-ed96ceb5debd tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0471342
May 20 16:17:23.837881 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-f87b262f-a117-44c1-8942-a1bb38012d35 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1395602
May 20 16:17:23.988850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3fddccb-1977-46ff-b70e-9e0085fd9445 req-8036265b-aadd-41f6-86c6-d360a7c9fe90 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:23.991958 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f3fddccb-1977-46ff-b70e-9e0085fd9445 req-8036265b-aadd-41f6-86c6-d360a7c9fe90 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.0930302
May 20 16:17:24.001131 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-05ea55b0-7560-4ef6-a2b6-2c2b500a553e req-d0d79b98-1928-4064-98c7-ae9ecd30bb56 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1570890
May 20 16:17:24.002020 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57396) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:24.007562 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'floatingip': {'port_id': '4c1d2c1d-f53f-4921-822b-db24d856090e'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:24.091342 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:24.741080 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5e3a63-0b8e-47f2-9d12-271217558d29 req-01867c3b-7433-4c3b-b557-8840ec5e3081 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:24.742514 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7e5e3a63-0b8e-47f2-9d12-271217558d29 req-01867c3b-7433-4c3b-b557-8840ec5e3081 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.3109677
May 20 16:17:24.820157 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7e5e3a63-0b8e-47f2-9d12-271217558d29 req-099fe49f-9fe2-4fdd-8a7d-ce527b252a11 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0662091
May 20 16:17:25.030237 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:25.174711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:25.350540 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Floating IP 83b2ed64-36e8-479f-b5f3-2377b5deada1 associated. External IP: 172.27.0.28, port: 4c1d2c1d-f53f-4921-822b-db24d856090e.
May 20 16:17:25.727046 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Router 7ca2542d-958b-4848-b460-42f1d2b2dd11 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:17:26.140613 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:17:26.146898 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:26.155644 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] Sync routers for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:17:26.165707 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:17:26.166391 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712bde1c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:17:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:26.212236 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cec89e0-c127-48a8-a79d-8cc1ac1a2695 req-215e2197-14a3-48fe-a0c0-1b7c61153b1b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:26.213727 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6cec89e0-c127-48a8-a79d-8cc1ac1a2695 req-215e2197-14a3-48fe-a0c0-1b7c61153b1b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.2301033
May 20 16:17:26.220402 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-43a30007-ac96-4e9e-9ae1-f9a9740f79de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "PUT /v2.0/floatingips/83b2ed64-36e8-479f-b5f3-2377b5deada1 HTTP/1.1" status: 200  len: 990 time: 2.2171943
May 20 16:17:26.221277 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:26.290425 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6cec89e0-c127-48a8-a79d-8cc1ac1a2695 req-b08ed993-5685-45d4-8eca-b6128aab12fc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0602243
May 20 16:17:26.369862 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'status': 'completed', 'code': 200}
May 20 16:17:26.384067 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:17:26.735719 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712bde1c0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '83b2ed64-36e8-479f-b5f3-2377b5deada1', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'floating_ip_address': '172.27.0.28', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'port_id': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 103, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'mac_address': 'fa:16:3e:eb:92:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:16:53Z', 'updated_at': '2021-05-20T16:17:24Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:26.739731 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] Checking router: 7ca2542d-958b-4848-b460-42f1d2b2dd11 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:17:26.748921 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:17:26.749520 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712bde1c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:17:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:26.803616 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57470) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:26.919164 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:26.921497 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:17:26.936371 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:26.940254 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Usage tracker for resource:security_group_rule and tenant:9fb96e9823d544e4a92cdf48e176f433 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:26.943090 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:26.948797 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:27.031402 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:27.122659 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:27.131681 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-cf1ae4c4-d6bb-4cb0-810d-3414fb0047bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:27.169184 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ccae8fa-45b5-4d86-a3a7-7d89f29c2c4f,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:27.176742 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=9fb96e9823d544e4a92cdf48e176f433&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3719864
May 20 16:17:27.177428 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57478) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:27.177919 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:27.241497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:27.272488 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:27.304702 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712bde1c0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '83b2ed64-36e8-479f-b5f3-2377b5deada1', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'floating_ip_address': '172.27.0.28', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'port_id': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 103, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'mac_address': 'fa:16:3e:eb:92:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:16:53Z', 'updated_at': '2021-05-20T16:17:24Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:27.308514 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddeedf56-a921-4198-ac3a-55963a180d10 None None] The sync data for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi is: [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '83b2ed64-36e8-479f-b5f3-2377b5deada1', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'floating_ip_address': '172.27.0.28', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'port_id': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 103, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'mac_address': 'fa:16:3e:eb:92:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:16:53Z', 'updated_at': '2021-05-20T16:17:24Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:17:27.374673 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:27.380130 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:27.397704 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ccae8fa-45b5-4d86-a3a7-7d89f29c2c4f,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:27.400309 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:27.402628 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:27.403974 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/6ccae8fa-45b5-4d86-a3a7-7d89f29c2c4f HTTP/1.1" status: 204  len: 168 time: 0.2240758
May 20 16:17:27.513076 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e70647a5-7885-4ede-976b-001970378dd9 req-b3ffa3a4-7dfc-46f5-aa97-e8b815352144 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:27.515091 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e70647a5-7885-4ede-976b-001970378dd9 req-b3ffa3a4-7dfc-46f5-aa97-e8b815352144 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1011424
May 20 16:17:27.544362 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05c683e2-ee62-491d-95ed-300ce32e5488 None None] New status for floating IP 83b2ed64-36e8-479f-b5f3-2377b5deada1: ACTIVE {{(pid=92423) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:17:27.563298 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e70647a5-7885-4ede-976b-001970378dd9 req-ef0c0061-2ca6-4c8f-ad39-e2b18a36a960 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416481
May 20 16:17:28.035854 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57496) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:28.054078 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.068186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:28.072079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Usage tracker for resource:security_group_rule and tenant:78702056bb5043bc9bad7dde14f8bb57 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:28.074881 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:28.080610 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:28.167825 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.225813 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.233240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:28.273690 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=78702056bb5043bc9bad7dde14f8bb57&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2367330
May 20 16:17:28.274551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b81e78dd-a47f-4c5b-b4b3-cb44dbe0dde8,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:28.276389 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57502) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:28.277478 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:28.345433 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.374030 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.494433 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.523046 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.527146 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8c4e17a3-2441-4f76-ac5f-f2e7f7b8186a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:28.540957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b81e78dd-a47f-4c5b-b4b3-cb44dbe0dde8,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:28.544784 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:28.566985 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:28.568144 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/b81e78dd-a47f-4c5b-b4b3-cb44dbe0dde8 HTTP/1.1" status: 204  len: 168 time: 0.2872403
May 20 16:17:28.768186 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-cecae200-8545-4837-850c-a6b2eed9ea4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:28.770786 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-cecae200-8545-4837-850c-a6b2eed9ea4a service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1098 time: 0.1063304
May 20 16:17:28.773715 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45732a7d-59b7-456c-8c5f-0a6c4b13c13e req-f3b0194e-103d-47bc-9964-e952de7f5366 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:28.775214 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-45732a7d-59b7-456c-8c5f-0a6c4b13c13e req-f3b0194e-103d-47bc-9964-e952de7f5366 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1013300
May 20 16:17:28.825696 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-45732a7d-59b7-456c-8c5f-0a6c4b13c13e req-c0025ad5-f4ee-471c-be47-500f49f377e8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436914
May 20 16:17:28.980991 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-4dc7b7c7-78aa-435b-b233-6d966770cbff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:28.982466 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-4dc7b7c7-78aa-435b-b233-6d966770cbff service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.2037070
May 20 16:17:29.087934 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-ed33d398-1b77-4bf0-8b51-e078ad4ffaad service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 1000 time: 0.0976796
May 20 16:17:29.158955 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-35ddc231-3e56-4a42-8128-a4e0e5fd015b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:29.160453 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-35ddc231-3e56-4a42-8128-a4e0e5fd015b service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0620115
May 20 16:17:29.244004 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-f6c97ff0-ef28-4d7d-ae85-692f4195ebb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:29.245480 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-f6c97ff0-ef28-4d7d-ae85-692f4195ebb6 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0720923
May 20 16:17:29.381238 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-d9fb5162-13ff-4355-bc1a-9bbb34bee4f6 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1279526
May 20 16:17:29.520895 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-7fa73842-23c8-4d94-8fe0-d9cf1a53434e req-72c5cc13-c724-4978-9561-a28d882edcf3 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1280975
May 20 16:17:30.088547 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c2e5b2-b6ea-4474-a6d8-70dc370f0f2e req-e3f59746-0359-4325-a828-726f7f4b28a8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:30.089927 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-37c2e5b2-b6ea-4474-a6d8-70dc370f0f2e req-e3f59746-0359-4325-a828-726f7f4b28a8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1498773
May 20 16:17:30.134698 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-37c2e5b2-b6ea-4474-a6d8-70dc370f0f2e req-c39cd1f0-0cbc-4d83-af9b-6aacaf3666c9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386863
May 20 16:17:31.328673 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-766957e9-06a6-43da-ab02-05c8e793a4a9 req-8fcc038b-27d8-431f-81ea-52d6bdb4cac3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:31.331006 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-766957e9-06a6-43da-ab02-05c8e793a4a9 req-8fcc038b-27d8-431f-81ea-52d6bdb4cac3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0857012
May 20 16:17:31.377272 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-766957e9-06a6-43da-ab02-05c8e793a4a9 req-51ca1aee-e817-4bad-ab65-76fbdc7b5f4a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405307
May 20 16:17:31.963167 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:17:32.587753 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1045b9d4-f67a-4692-be40-4c7afc320745 req-dcaccc17-822e-447d-8e1d-b3c545ac925a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:32.589389 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1045b9d4-f67a-4692-be40-4c7afc320745 req-dcaccc17-822e-447d-8e1d-b3c545ac925a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0847340
May 20 16:17:32.651679 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1045b9d4-f67a-4692-be40-4c7afc320745 req-c26a4d7e-0ba0-4c13-a5f4-45c461e7c67a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528276
May 20 16:17:33.875805 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249a0051-54b1-4738-aee1-4bb8afc57ac4 req-01ff8ee6-8359-476d-bd95-d8c73853b014 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:33.877519 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-249a0051-54b1-4738-aee1-4bb8afc57ac4 req-01ff8ee6-8359-476d-bd95-d8c73853b014 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1002607
May 20 16:17:33.924710 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-249a0051-54b1-4738-aee1-4bb8afc57ac4 req-28a49e38-a5fe-4d19-82ed-74bc032d92df tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407040
May 20 16:17:35.121241 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865cc404-8021-4ad7-a8a5-9456c1c80ae2 req-8ab17b3a-4ee8-4a54-80aa-52647beeedfe tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:35.122900 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-865cc404-8021-4ad7-a8a5-9456c1c80ae2 req-8ab17b3a-4ee8-4a54-80aa-52647beeedfe tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0822146
May 20 16:17:35.174382 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-865cc404-8021-4ad7-a8a5-9456c1c80ae2 req-e9e07d5e-50e2-46e0-a875-9e7ff44a40a6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449145
May 20 16:17:36.377719 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99f20c49-5d31-4721-9101-e666c7fc2768 req-de03cb27-67f3-44a8-92e9-5f43fd9cc659 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:36.379249 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-99f20c49-5d31-4721-9101-e666c7fc2768 req-de03cb27-67f3-44a8-92e9-5f43fd9cc659 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0828984
May 20 16:17:36.424176 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-99f20c49-5d31-4721-9101-e666c7fc2768 req-366f20a5-8a9b-49ce-9396-e81d191fe4aa tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390046
May 20 16:17:37.633637 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1883026c-e990-4785-a638-3d26ee0cc136 req-d35158ca-8dca-4872-9849-76800e167704 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:37.635295 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1883026c-e990-4785-a638-3d26ee0cc136 req-d35158ca-8dca-4872-9849-76800e167704 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0952058
May 20 16:17:37.682243 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1883026c-e990-4785-a638-3d26ee0cc136 req-baafcdac-f9bb-453a-915a-438a556d4bde tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397561
May 20 16:17:38.440841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57840) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:38.572304 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:38.578677 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:38.582458 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Usage tracker for resource:security_group_rule and tenant:574abdedf7af4d608989587394abb8fe is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:38.585328 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:38.591225 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:38.674361 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:38.752437 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:38.761892 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:38.806028 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=574abdedf7af4d608989587394abb8fe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3639283
May 20 16:17:38.809889 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57848) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:38.849526 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8ee944f-d53b-496e-a068-b17f5eeb2666,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:38.865366 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.865711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.866250 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.866629 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.866922 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.867438 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.868017 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.868354 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.868685 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.869007 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.869332 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.870074 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:38.880644 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:38.895415 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:38.910838 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b67fde48-1c5e-4e0f-9dc9-dba660b02aca req-e1379046-f94c-448e-8a47-068a52ff7361 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:38.912374 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b67fde48-1c5e-4e0f-9dc9-dba660b02aca req-e1379046-f94c-448e-8a47-068a52ff7361 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1132193
May 20 16:17:38.921933 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:38.961868 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b67fde48-1c5e-4e0f-9dc9-dba660b02aca req-1d5fa6f2-eb42-45e1-a7eb-bc9995099de7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433476
May 20 16:17:39.059747 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:39.063648 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-42a59b20-bfb5-47d2-bbdc-0470008695c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:39.074846 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8ee944f-d53b-496e-a068-b17f5eeb2666,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:39.085135 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:39.086253 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/f8ee944f-d53b-496e-a068-b17f5eeb2666 HTTP/1.1" status: 204  len: 168 time: 0.2753942
May 20 16:17:39.087705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.088065 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.088415 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.088761 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.089288 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.089633 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.089976 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.090318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.090660 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.090998 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.091361 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.092218 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:17:39.095452 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:39.772125 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57876) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:39.790514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:39.809595 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:39.813512 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Usage tracker for resource:security_group_rule and tenant:92082c4c01c24fde903fdbd8b80e4261 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:39.816410 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:39.822237 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:39.891451 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583efbff-acb0-42a6-b66c-2c56a14f614b req-48cdbcce-b28d-4d03-8e1f-48fa7a599dc0 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:39.892959 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-583efbff-acb0-42a6-b66c-2c56a14f614b req-48cdbcce-b28d-4d03-8e1f-48fa7a599dc0 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.0844963
May 20 16:17:39.911288 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:39.941376 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-583efbff-acb0-42a6-b66c-2c56a14f614b req-d55cb63a-952b-4d5a-8e4d-222d771f48bc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413775
May 20 16:17:40.003128 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.010492 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e9f4a92d-aca2-4cbb-93c0-cb7c926b25c1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:40.061146 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c987d154-4f94-4c84-b10b-5d0073a853ee,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:40.061146 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=92082c4c01c24fde903fdbd8b80e4261&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2847183
May 20 16:17:40.061146 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:40.061575 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57884) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:40.184653 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.194398 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57894) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:40.246681 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.324797 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-048087b1-6ed1-4dec-aa24-0d18f6f1838b req-0baf0cf1-7bc1-4792-b238-f7076dacbd2d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:40.328213 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-048087b1-6ed1-4dec-aa24-0d18f6f1838b req-0baf0cf1-7bc1-4792-b238-f7076dacbd2d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1985102
May 20 16:17:40.403296 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.419076 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-048087b1-6ed1-4dec-aa24-0d18f6f1838b req-39103712-b8f3-44c6-a0d3-2b15e446edb3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0843678
May 20 16:17:40.423406 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:40.427966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Usage tracker for resource:security_group_rule and tenant:4cab567b56eb4a0090be0b7cb55f57a8 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:40.430406 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:40.436862 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:40.443278 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.449027 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-80ee620b-7e10-4b79-bf4d-8878c0eb7592 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:40.470185 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c987d154-4f94-4c84-b10b-5d0073a853ee,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:40.483225 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:40.498299 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.499428 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/c987d154-4f94-4c84-b10b-5d0073a853ee HTTP/1.1" status: 204  len: 168 time: 0.4371388
May 20 16:17:40.557937 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.643015 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.654188 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:40.690020 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18333afe-60e5-4d7c-94a0-067acff35d66,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:40.694007 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=4cab567b56eb4a0090be0b7cb55f57a8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5015600
May 20 16:17:40.694842 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:40.696711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57912) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:40.758006 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.789368 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.939956 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.943805 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:40.964952 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18333afe-60e5-4d7c-94a0-067acff35d66,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:40.964952 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:40.987741 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:40.988877 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/18333afe-60e5-4d7c-94a0-067acff35d66 HTTP/1.1" status: 204  len: 168 time: 0.2912416
May 20 16:17:41.227224 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ffd20b-0f52-4702-bdcf-610649f421f8 req-54623547-e8e7-42dc-a7b1-b3292f60865f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:41.228842 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-41ffd20b-0f52-4702-bdcf-610649f421f8 req-54623547-e8e7-42dc-a7b1-b3292f60865f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.1070433
May 20 16:17:41.284112 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-41ffd20b-0f52-4702-bdcf-610649f421f8 req-7ee00417-50c3-4e4f-9e9c-9a03095ba688 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485339
May 20 16:17:41.621477 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 57950) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:41.639602 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:41.642545 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5e81e4-d7f2-4615-9e67-02e11bfc9349 req-8c0c0b05-1cd9-44ed-9e54-5b620d0f4c63 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:41.644105 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fe5e81e4-d7f2-4615-9e67-02e11bfc9349 req-8c0c0b05-1cd9-44ed-9e54-5b620d0f4c63 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0956888
May 20 16:17:41.656404 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:41.660544 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Usage tracker for resource:security_group_rule and tenant:c4b0bf73a45541ebb62e4f4b3183b95b is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:41.672406 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:41.678656 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:41.700667 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fe5e81e4-d7f2-4615-9e67-02e11bfc9349 req-a4a3caf8-d575-46d4-8381-f182d60a4b1a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485392
May 20 16:17:41.794304 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:41.853969 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:41.862861 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6cc5875c-8ee7-4e3c-9026-de5093b36834 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:41.901289 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=c4b0bf73a45541ebb62e4f4b3183b95b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2787197
May 20 16:17:41.902856 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e62cb3c-ff02-4c6a-8e44-81e0ef6b81a7,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:41.904834 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 57958) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:41.906353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:41.966214 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:41.993921 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:42.168329 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:42.173809 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:42.194457 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e62cb3c-ff02-4c6a-8e44-81e0ef6b81a7,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:42.197454 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:42.198584 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:42.200082 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/0e62cb3c-ff02-4c6a-8e44-81e0ef6b81a7 HTTP/1.1" status: 204  len: 168 time: 0.2942932
May 20 16:17:42.479521 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d073bf9-bfb1-4a31-9c44-3f3bfab99253 req-b5fecac6-0210-4701-ad00-4af18c37d316 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:42.481130 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0d073bf9-bfb1-4a31-9c44-3f3bfab99253 req-b5fecac6-0210-4701-ad00-4af18c37d316 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.0853934
May 20 16:17:42.533335 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0d073bf9-bfb1-4a31-9c44-3f3bfab99253 req-7f68f63d-5f15-4dff-bc91-3522d0092cbe tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/security-groups?id=af385028-d2f7-4719-81cf-7a02220b68f5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458107
May 20 16:17:42.813787 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac80c342-99df-422a-add6-0b49d153f045 req-bb19f9e0-3c8f-4303-a24c-0b9e1a5471a4 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:42.816214 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ac80c342-99df-422a-add6-0b49d153f045 req-bb19f9e0-3c8f-4303-a24c-0b9e1a5471a4 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.16 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 946 time: 0.1255546
May 20 16:17:42.974966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c391c985-c1c4-46a6-9578-48a0a861c790 req-73825bb8-efb9-47e8-8a06-1ca0c1bc6d57 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:42.976509 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c391c985-c1c4-46a6-9578-48a0a861c790 req-73825bb8-efb9-47e8-8a06-1ca0c1bc6d57 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1471961
May 20 16:17:42.992147 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Deleting port 0ea6d03c-015e-4b25-bea8-4db73fba158e {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:17:42.996340 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:43.043348 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c391c985-c1c4-46a6-9578-48a0a861c790 req-f4a636ee-7b9c-464d-83f9-fd80e7c8a9a5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0598507
May 20 16:17:43.179279 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] For port 0ea6d03c-015e-4b25-bea8-4db73fba158e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=0ea6d03c-015e-4b25-bea8-4db73fba158e,segment=NetworkSegment(6693d38d-3373-4cfe-8791-6de4025dd8b2),segment_id=6693d38d-3373-4cfe-8791-6de4025dd8b2)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:17:43.179642 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:43.334938 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Calling delete_port for 0ea6d03c-015e-4b25-bea8-4db73fba158e owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:17:43.586049 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:43.593559 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-cea075d3-7db4-4d4b-bad5-d9e4b0e9c5f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:43.600061 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['0ea6d03c-015e-4b25-bea8-4db73fba158e'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:17:43.841135 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Pushing event deleted for resources: {'Port': ['ID=0ea6d03c-015e-4b25-bea8-4db73fba158e,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:43.851579 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:43.902080 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-757f765c-f06b-43a9-8cb1-573810bb9962 req-6153b09f-6a9a-4ca5-85a0-251781837422 tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.1260464
May 20 16:17:43.905394 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] No DVR routers for this DVR port 0ea6d03c-015e-4b25-bea8-4db73fba158e on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:17:43.909066 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:43.923155 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2103aba6-9c9a-4eef-a289-d656208928fc', 'name': 'network-vif-deleted', 'tag': '0ea6d03c-015e-4b25-bea8-4db73fba158e'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:43.983781 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2103aba6-9c9a-4eef-a289-d656208928fc', 'name': 'network-vif-deleted', 'tag': '0ea6d03c-015e-4b25-bea8-4db73fba158e', 'status': 'completed', 'code': 200}
May 20 16:17:44.078095 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ac80c342-99df-422a-add6-0b49d153f045 req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.16 "DELETE /v2.0/ports/0ea6d03c-015e-4b25-bea8-4db73fba158e HTTP/1.1" status: 204  len: 173 time: 1.2416499
May 20 16:17:44.253600 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d7cabe-ad61-4480-8f7c-afed1ad69e61 req-bd83cc66-ed24-43b6-a905-f7e65ee90c21 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:44.254093 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-14d7cabe-ad61-4480-8f7c-afed1ad69e61 req-bd83cc66-ed24-43b6-a905-f7e65ee90c21 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0861845
May 20 16:17:44.300680 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-14d7cabe-ad61-4480-8f7c-afed1ad69e61 req-62f278ee-f6c1-4553-b938-2509c7cf64fe tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403318
May 20 16:17:44.531645 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58052) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:44.649065 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:44.662822 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:44.666533 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Usage tracker for resource:security_group_rule and tenant:0394b241e66d47bb832880e845a82f86 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:44.669290 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:44.675518 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:44.755945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:44.802433 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:44.814165 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-03a52623-0b19-4da2-838c-3274467e3156 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:44.854720 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=0394b241e66d47bb832880e845a82f86&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3219249
May 20 16:17:44.856484 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64dcea44-453a-4201-a4ef-6f40a56e287c,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:44.856629 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 58058) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:44.859662 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:44.926159 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:44.956372 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:45.129374 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-63f7ad3f-f0f2-4452-a9fb-3a2f28debde0 req-7388b3ab-d9ab-4334-8c43-90c7a6ba045f tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] 10.222.0.64 "GET /v2.0/ports?device_id=2103aba6-9c9a-4eef-a289-d656208928fc HTTP/1.1" status: 200  len: 210 time: 0.0458295
May 20 16:17:45.134808 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:45.140184 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:45.150712 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64dcea44-453a-4201-a4ef-6f40a56e287c,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:45.160386 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:45.163947 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:45.165147 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/64dcea44-453a-4201-a4ef-6f40a56e287c HTTP/1.1" status: 204  len: 168 time: 0.3075025
May 20 16:17:45.496693 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05bb0bd-23ab-41ca-a601-12a1f3750ce8 req-2f854dfc-4008-47e2-8591-62d941795b29 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:45.498256 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f05bb0bd-23ab-41ca-a601-12a1f3750ce8 req-2f854dfc-4008-47e2-8591-62d941795b29 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0870178
May 20 16:17:45.591888 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f05bb0bd-23ab-41ca-a601-12a1f3750ce8 req-40900746-77bd-404d-94f1-0b4ee2232cc2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0856102
May 20 16:17:45.992216 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4c9850cb-d89c-4167-8226-1da7fe3c326e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:46.697839 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 0ea6d03c-015e-4b25-bea8-4db73fba158e no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:17:46.763455 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 0ea6d03c-015e-4b25-bea8-4db73fba158e {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:17:46.763803 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 0ea6d03c-015e-4b25-bea8-4db73fba158e not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:17:46.826152 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ca9b6-b9cd-4c4a-ac4f-5199cb1226f4 req-0ab8c3f2-3031-4ab3-b1bd-c4dd5a422968 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:46.827637 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b7ca9b6-b9cd-4c4a-ac4f-5199cb1226f4 req-0ab8c3f2-3031-4ab3-b1bd-c4dd5a422968 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0846412
May 20 16:17:46.874370 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b7ca9b6-b9cd-4c4a-ac4f-5199cb1226f4 req-7271e34d-09fb-4248-969d-894d135bbe36 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407269
May 20 16:17:47.547660 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-8c97ad14-5ba9-423a-83f8-95c59ae74daa tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:47.549128 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-8c97ad14-5ba9-423a-83f8-95c59ae74daa tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.1639614
May 20 16:17:47.565208 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-9ef9fc8f-7848-4e62-9f0c-22fa2bc51ea8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/quotas/747fc4332771467fa24e6bc07899b54f HTTP/1.1" status: 200  len: 375 time: 0.0098503
May 20 16:17:47.656216 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-c3230692-baa7-4934-b9c4-fd332b9b3718 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0851171
May 20 16:17:47.797612 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-a28bee1b-049f-4555-b18c-92ea82ecc05f service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1335382
May 20 16:17:47.936141 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-a27b870b-6824-4da7-b2ae-eca3ca039607 service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1325090
May 20 16:17:48.085834 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517c1528-2c22-4959-a46b-9bc4f1244bee req-fc66b3d0-18e3-4ed4-b884-228ccb039c5e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:48.087210 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 58202) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:48.087727 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-517c1528-2c22-4959-a46b-9bc4f1244bee req-fc66b3d0-18e3-4ed4-b884-228ccb039c5e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0983012
May 20 16:17:48.149039 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-517c1528-2c22-4959-a46b-9bc4f1244bee req-262268db-dabe-4abd-9fe3-9ce4499e3cc7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0526280
May 20 16:17:48.270571 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.305912 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e8fdfe42-f033-4c9d-be7d-410631273848 req-ed7b8a50-9d31-4d4c-98af-b274aec100ae tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0517075
May 20 16:17:48.313885 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:48.319020 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Usage tracker for resource:security_group_rule and tenant:6aecda74814c46718b184cace03e8d65 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:48.322172 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:48.334196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:48.442524 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.488819 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.546120 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.560828 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-08631abd-ff35-4500-89d6-a9c48e9841a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:48.608864 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-41dc89ed-8506-4949-a771-5a4b1dc9c611 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.618681 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58236) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:48.618876 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=6aecda74814c46718b184cace03e8d65&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5303977
May 20 16:17:48.619545 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cc01ff6-765e-4e35-80df-7c3346dd63cb,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:48.622903 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:48.713132 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.741254 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.854927 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.861351 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:48.873787 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cc01ff6-765e-4e35-80df-7c3346dd63cb,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:48.876435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:48.892546 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:48.894012 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/2cc01ff6-765e-4e35-80df-7c3346dd63cb HTTP/1.1" status: 204  len: 168 time: 0.2739997
May 20 16:17:49.352610 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec4ee76-3b26-4309-9120-dc1acb756ec5 req-3e9e9d9b-9832-44ca-b440-548cecf61fae tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:49.358323 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ec4ee76-3b26-4309-9120-dc1acb756ec5 req-3e9e9d9b-9832-44ca-b440-548cecf61fae tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0994940
May 20 16:17:49.410047 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ec4ee76-3b26-4309-9120-dc1acb756ec5 req-cd4e2dd5-eeaa-4032-9d93-6f4c15d7e7b3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454235
May 20 16:17:49.493989 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-40cf80f2-29bd-426c-94a2-2b31def83565 req-c5cbc44f-b0fd-4352-993a-68e165a1b977 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0497823
May 20 16:17:49.609820 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58264) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:49.655259 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:49.676861 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Deleting subnet 62bb207d-d1f6-4694-870b-d608e6900fa3 {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:17:49.679857 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:49.729230 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:49.791509 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 58274) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:49.806213 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:49.837930 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:49.860979 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:49.871208 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Usage tracker for resource:security_group_rule and tenant:fd455c3dcded4d1292abd1b21f553ecc is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:17:49.871208 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:17:49.875971 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:49.996959 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.225922 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.234355 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:50.276343 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=fd455c3dcded4d1292abd1b21f553ecc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4831870
May 20 16:17:50.278207 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1b13ace-09fa-432f-bc63-f55bac788895,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:50.279219 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58282) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:50.281655 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:50.340973 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.365612 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.443262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.447939 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:50.481302 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=62bb207d-d1f6-4694-870b-d608e6900fa3,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:50.484563 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:50.492930 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.521004 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] 10.222.0.64 "DELETE /v2.0/subnets/62bb207d-d1f6-4694-870b-d608e6900fa3 HTTP/1.1" status: 204  len: 168 time: 0.9094260
May 20 16:17:50.523297 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58290) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:50.561506 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.564046 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.565193 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/c1b13ace-09fa-432f-bc63-f55bac788895 HTTP/1.1" status: 204  len: 168 time: 0.2849944
May 20 16:17:50.612262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e82be048-babb-4907-9c07-d24cc95574eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:50.720304 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1b13ace-09fa-432f-bc63-f55bac788895,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:50.722732 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:50.761616 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-54599fc7-a2b2-41e6-9ece-c1eb435d7b9c req-2476e3b0-3ccd-4841-8012-c4f99f9dd919 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.1295617
May 20 16:17:50.771622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:50.791309 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2c3261ff-8cac-4ea5-a646-ea812d54d619 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:50.792948 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2c3261ff-8cac-4ea5-a646-ea812d54d619 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.1671181
May 20 16:17:50.803763 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beaa4f8d-2d7b-4822-8fb7-1085700c6069 req-e27c8666-d1af-452f-a019-880f0b6dbae7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:50.805337 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-beaa4f8d-2d7b-4822-8fb7-1085700c6069 req-e27c8666-d1af-452f-a019-880f0b6dbae7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.2495904
May 20 16:17:50.809267 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Request body: {'port': {'device_id': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'admin_state_up': True, 'tenant_id': '747fc4332771467fa24e6bc07899b54f'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:51.015115 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-beaa4f8d-2d7b-4822-8fb7-1085700c6069 req-8cc4a7dc-4703-4c6d-8a6e-7fa0f01753e0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1750410
May 20 16:17:51.015115 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.028430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:17:51.051111 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe711b86910>,) {'filters': {'network_id': ['679d7722-330c-49b6-b5b8-e851267c2357']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:51.057774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:17:51.078713 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711b86910>, '6693d38d-3373-4cfe-8791-6de4025dd8b2') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:51.079118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711b86910>, '6693d38d-3373-4cfe-8791-6de4025dd8b2') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:17:51.094765 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.118247 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.127120 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Releasing vlan 643 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:17:51.127551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:17:51.150774 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:17:51.283125 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Made reservation on behalf of 747fc4332771467fa24e6bc07899b54f for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:17:51.283429 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.290050 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.346970 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.351739 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:51.371399 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.374015 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Pushing event deleted for resources: {'Network': ['ID=679d7722-330c-49b6-b5b8-e851267c2357,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:51.382318 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:51.459439 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Allocated IP 172.20.0.2 (7250e4c3-f4ff-4878-8316-65dfc0975bd3/924a520e-53e5-4777-beb9-f9e6d0bd0dff/aa3b98da-a0e8-4ea3-81bb-be3921b39120) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:17:51.530469 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] 10.222.0.64 "DELETE /v2.0/networks/679d7722-330c-49b6-b5b8-e851267c2357 HTTP/1.1" status: 204  len: 168 time: 1.0053458
May 20 16:17:51.675497 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.819777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:51.832803 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:51.839642 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:17:51.904796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:17:51.909447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:17:51.920962 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:17:51.927599 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58342) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:51.979505 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event updated for resources: {'Port': ['ID=aa3b98da-a0e8-4ea3-81bb-be3921b39120,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:51.993467 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:52.003466 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-7572475b-b057-46a7-ad39-ca3e35ffa90d admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=50d0b3d2f6dc41c492d29c820372735f&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0743527
May 20 16:17:52.005893 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58348) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:17:52.016187 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:52.017366 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.036167 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301a75a2-8359-4271-887c-4fa7e222b44a req-e5e60e78-533f-434e-ac06-f1ef56359656 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:52.055491 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301a75a2-8359-4271-887c-4fa7e222b44a req-e5e60e78-533f-434e-ac06-f1ef56359656 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 931 time: 0.1861515
May 20 16:17:52.137248 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301a75a2-8359-4271-887c-4fa7e222b44a req-4dca3fd3-4155-4aef-af3b-f169e581b7a8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0808237
May 20 16:17:52.159308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.197147 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.260559 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4558716
May 20 16:17:52.273796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Request body: {'port': {'device_id': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:17:52.337872 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c75cc4a-7a02-4a3a-a7e5-583514b2b86e req-2a44d868-b62a-4034-8aab-e0211d61e083 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:52.339651 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9c75cc4a-7a02-4a3a-a7e5-583514b2b86e req-2a44d868-b62a-4034-8aab-e0211d61e083 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0909312
May 20 16:17:52.373717 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.387514 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:52.409178 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.415643 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af385028-d2f7-4719-81cf-7a02220b68f5,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:52.418111 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:52.437660 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9c75cc4a-7a02-4a3a-a7e5-583514b2b86e req-99ccc221-6d6b-4abf-9a23-6ee0d6bcba75 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0919497
May 20 16:17:52.492144 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.493629 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/af385028-d2f7-4719-81cf-7a02220b68f5 HTTP/1.1" status: 204  len: 168 time: 0.4868588
May 20 16:17:52.812108 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aa3b98da-a0e8-4ea3-81bb-be3921b39120 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:17:52.816776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.833331 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Transition to ACTIVE for port object aa3b98da-a0e8-4ea3-81bb-be3921b39120 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:17:52.956948 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:52.962140 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-79f492dc-3668-4911-8000-e6a6177c8da5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:53.253666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Pushing event updated for resources: {'Port': ['ID=aa3b98da-a0e8-4ea3-81bb-be3921b39120,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:53.264663 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:53.360681 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Attempting to bind port aa3b98da-a0e8-4ea3-81bb-be3921b39120 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:17:53.361021 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Attempting to bind port aa3b98da-a0e8-4ea3-81bb-be3921b39120 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:17:53.361423 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Attempting to bind port aa3b98da-a0e8-4ea3-81bb-be3921b39120 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:53.367794 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Port aa3b98da-a0e8-4ea3-81bb-be3921b39120 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:17:53.368117 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Attempting to bind port aa3b98da-a0e8-4ea3-81bb-be3921b39120 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:17:53.379858 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-ab483774-b477-4eed-bfc4-f4e256419a6c service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2260926
May 20 16:17:53.380832 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 17, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:17:53.381201 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Checking segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:17:53.381583 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Bound using segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:17:53.382033 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Bound port: aa3b98da-a0e8-4ea3-81bb-be3921b39120, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:17:53.382381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:53.534799 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] For port aa3b98da-a0e8-4ea3-81bb-be3921b39120, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:17:53.538043 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] For port aa3b98da-a0e8-4ea3-81bb-be3921b39120, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=aa3b98da-a0e8-4ea3-81bb-be3921b39120,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:17:53.617678 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-20ce95f9-564a-412b-b743-9e19f6866821 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:53.619077 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-20ce95f9-564a-412b-b743-9e19f6866821 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 1099 time: 0.0797076
May 20 16:17:53.632025 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:53.637084 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-95c03425-f2ff-4e69-9753-22c3497b84ac tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:17:53.739007 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b94dbf-d77e-4303-a58b-49889c4b9a69 req-33201ea6-1d2f-4810-98fb-8259e076a0f4 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:53.746953 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Pushing event updated for resources: {'Port': ['ID=aa3b98da-a0e8-4ea3-81bb-be3921b39120,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:17:53.747744 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-90b94dbf-d77e-4303-a58b-49889c4b9a69 req-33201ea6-1d2f-4810-98fb-8259e076a0f4 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.2081065
May 20 16:17:53.754397 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:17:53.773972 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491f67e8-bd30-45de-9db9-2ac25d608774 req-a269c058-f835-48c1-b136-9f30f9ba3e0f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:53.775753 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-491f67e8-bd30-45de-9db9-2ac25d608774 req-a269c058-f835-48c1-b136-9f30f9ba3e0f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1446197
May 20 16:17:53.776804 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:53.777423 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:53.779596 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] 10.222.0.16 "PUT /v2.0/ports/aa3b98da-a0e8-4ea3-81bb-be3921b39120 HTTP/1.1" status: 200  len: 1093 time: 1.5100911
May 20 16:17:53.780084 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'tag': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:17:53.831895 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-90b94dbf-d77e-4303-a58b-49889c4b9a69 req-c6822717-c8d4-4663-b532-681272e28d0f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0828962
May 20 16:17:53.871020 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-491f67e8-bd30-45de-9db9-2ac25d608774 req-b592295d-018d-4868-97db-454113cd0870 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0747797
May 20 16:17:53.892473 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'tag': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', 'status': 'completed', 'code': 200}
May 20 16:17:53.896168 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-1efef4ab-00ec-49a6-afb6-c9e6c6bddbdf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:53.897651 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-1efef4ab-00ec-49a6-afb6-c9e6c6bddbdf service neutron] 10.222.0.16 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 916 time: 0.1756754
May 20 16:17:54.023841 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-9af4c9e6-e106-43b1-93b6-7fa87884887d service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4b373943-e984-4276-9601-6ed0d000265f HTTP/1.1" status: 200  len: 217 time: 0.1088574
May 20 16:17:54.110196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-80ec8d8e-f46c-4c0d-a917-c73c3e6b781f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:54.111700 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-80ec8d8e-f46c-4c0d-a917-c73c3e6b781f service neutron] 10.222.0.16 "GET /v2.0/subnets?id=924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 200  len: 855 time: 0.0796938
May 20 16:17:54.120504 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-657d80e3-c42d-461d-abb5-6cdc970f8beb req-5bdfa471-4a54-4a2a-a318-7bee19c5fd0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:54.121858 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-657d80e3-c42d-461d-abb5-6cdc970f8beb req-5bdfa471-4a54-4a2a-a318-7bee19c5fd0e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 1096 time: 0.1418779
May 20 16:17:54.204613 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-a2a74016-3b53-43bb-a774-0845fe1a78be service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=7250e4c3-f4ff-4878-8316-65dfc0975bd3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0640786
May 20 16:17:54.424831 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-657d80e3-c42d-461d-abb5-6cdc970f8beb req-366980a4-48f8-4620-88e5-1f4622610faf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:54.426291 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-657d80e3-c42d-461d-abb5-6cdc970f8beb req-366980a4-48f8-4620-88e5-1f4622610faf service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=747fc4332771467fa24e6bc07899b54f&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2846365
May 20 16:17:54.475555 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-778d9be6-9db0-4619-97be-e634d44a9ee8 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2531319
May 20 16:17:54.674733 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-657d80e3-c42d-461d-abb5-6cdc970f8beb req-f492189b-8852-49f0-8b79-02d9913e9730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:54.676260 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-657d80e3-c42d-461d-abb5-6cdc970f8beb req-f492189b-8852-49f0-8b79-02d9913e9730 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2402372
May 20 16:17:54.702372 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-986dc613-d46b-4bfd-8288-125dc4c4cdd9 req-670f0d01-94bd-4420-b2ac-b677afb1844a service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2180545
May 20 16:17:54.795156 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-c25cbc57-4c61-4831-a485-6cb9f8bcb307 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:54.797038 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-c25cbc57-4c61-4831-a485-6cb9f8bcb307 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 1096 time: 0.0764155
May 20 16:17:54.872472 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-ced0978f-6bb4-4c11-bfc2-e7cc0277edc7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=aa3b98da-a0e8-4ea3-81bb-be3921b39120 HTTP/1.1" status: 200  len: 217 time: 0.0609450
May 20 16:17:55.030470 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-4d88248f-2b9b-4ebd-8183-1101fa05d610 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:55.032050 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-4d88248f-2b9b-4ebd-8183-1101fa05d610 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 200  len: 855 time: 0.1500747
May 20 16:17:55.042935 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be90495-cb38-4372-ac33-1322e89e4f97 req-6b54b298-8e30-48d4-b187-797a11cb0e01 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:55.045108 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5be90495-cb38-4372-ac33-1322e89e4f97 req-6b54b298-8e30-48d4-b187-797a11cb0e01 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.0941248
May 20 16:17:55.080338 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-af6d415e-cc99-4d01-9241-66dd88cc69b4 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=7250e4c3-f4ff-4878-8316-65dfc0975bd3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0405710
May 20 16:17:55.222603 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-a4d9f9b6-3e5d-47d8-9fbf-165bc166b704 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1347349
May 20 16:17:55.232733 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5be90495-cb38-4372-ac33-1322e89e4f97 req-36aeda1d-7a1b-48d1-be8d-d697e51175b7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1426558
May 20 16:17:55.283060 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28a0122-0190-4761-ae29-99df6c6a3b99 req-3564e2fb-fa52-4b9b-9624-ce470fc18d1e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:55.286597 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f28a0122-0190-4761-ae29-99df6c6a3b99 req-3564e2fb-fa52-4b9b-9624-ce470fc18d1e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.2405698
May 20 16:17:55.338392 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f28a0122-0190-4761-ae29-99df6c6a3b99 req-4b92e2dc-0e36-4e31-bee7-7e3c12022210 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0450568
May 20 16:17:55.389333 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fc7018b0-1d55-4f29-b56a-b23698a9cf65 req-668341be-d846-4563-ac8e-841e81a9c3d7 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1529927
May 20 16:17:56.427822 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ec1c90-6573-4edb-9fe8-1a8429bf798b req-2cd20506-12fc-4696-abf7-3888e6e3d6f3 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:56.429405 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e2ec1c90-6573-4edb-9fe8-1a8429bf798b req-2cd20506-12fc-4696-abf7-3888e6e3d6f3 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.0832036
May 20 16:17:56.527691 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e2ec1c90-6573-4edb-9fe8-1a8429bf798b req-c9c35d51-987b-428e-bde2-552101322649 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0923467
May 20 16:17:56.553966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ee5e593-c77f-4bd5-bb1f-e5e2689062e3 req-2cad4917-160a-4752-a14e-482fe717dfed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:56.555415 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2ee5e593-c77f-4bd5-bb1f-e5e2689062e3 req-2cad4917-160a-4752-a14e-482fe717dfed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1066318
May 20 16:17:56.599326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2ee5e593-c77f-4bd5-bb1f-e5e2689062e3 req-1f02645d-35e9-4881-a268-18dd04d00905 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380583
May 20 16:17:57.767786 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc33d2a-336b-43e7-b210-fa27f3414d2b req-d5eb98bd-6967-434c-a01f-5297de49c843 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:57.769280 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9dc33d2a-336b-43e7-b210-fa27f3414d2b req-d5eb98bd-6967-434c-a01f-5297de49c843 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.1306064
May 20 16:17:57.825709 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9dc33d2a-336b-43e7-b210-fa27f3414d2b req-69936a0c-a5cd-4a90-8caf-29deacef5d1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496352
May 20 16:17:57.840218 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776aa6f5-fee4-4838-b97b-dc96fcd9938d req-f4f2424b-02a8-4c0d-9eb0-94d132510603 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:57.842213 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-776aa6f5-fee4-4838-b97b-dc96fcd9938d req-f4f2424b-02a8-4c0d-9eb0-94d132510603 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1278706
May 20 16:17:57.890420 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-776aa6f5-fee4-4838-b97b-dc96fcd9938d req-1b50f10e-9261-4e66-9b6d-92850136aa20 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420842
May 20 16:17:58.568353 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:17:59.054106 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe2cb91-a634-4d36-bad8-8c74808edfe1 req-1729b972-330f-4386-b806-aa72b68bc035 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:59.055652 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bfe2cb91-a634-4d36-bad8-8c74808edfe1 req-1729b972-330f-4386-b806-aa72b68bc035 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.1187186
May 20 16:17:59.102871 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bfe2cb91-a634-4d36-bad8-8c74808edfe1 req-38a178de-8112-4956-bd8f-3599a41d02ed tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403571
May 20 16:17:59.301125 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228fadd5-0e04-48dd-b211-ae8d4663a22a req-bc8ff83e-72df-4cf7-b125-d04c66308f5c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:17:59.302652 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-228fadd5-0e04-48dd-b211-ae8d4663a22a req-bc8ff83e-72df-4cf7-b125-d04c66308f5c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0998001
May 20 16:17:59.349953 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-228fadd5-0e04-48dd-b211-ae8d4663a22a req-917b478d-8430-42a3-acdd-e2beb8b97853 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412035
May 20 16:18:00.302245 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d3c7906-afd1-428d-ac81-5068539bbb0d req-3c0c3697-65b3-4179-989f-e03f8f1f13a7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:00.303727 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d3c7906-afd1-428d-ac81-5068539bbb0d req-3c0c3697-65b3-4179-989f-e03f8f1f13a7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.0919619
May 20 16:18:00.348810 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d3c7906-afd1-428d-ac81-5068539bbb0d req-a277188d-7992-46ab-950d-f2b54caf73d6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392900
May 20 16:18:00.539771 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b518b948-af92-4fa8-b2d8-2a5b32a0230f req-b37e6455-b367-4c29-9bcd-673e83fb61a9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:00.541228 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b518b948-af92-4fa8-b2d8-2a5b32a0230f req-b37e6455-b367-4c29-9bcd-673e83fb61a9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0849860
May 20 16:18:00.586333 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b518b948-af92-4fa8-b2d8-2a5b32a0230f req-b961b6bd-ceb3-4179-ac8b-49d5032aaad5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392773
May 20 16:18:01.657730 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f49260f-06b2-4ab2-a75e-f6f9b7771f8c req-f57d0627-5b48-4e3c-ae03-f85ccd292f15 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:01.657730 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1f49260f-06b2-4ab2-a75e-f6f9b7771f8c req-f57d0627-5b48-4e3c-ae03-f85ccd292f15 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.0853028
May 20 16:18:01.657730 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1f49260f-06b2-4ab2-a75e-f6f9b7771f8c req-2193b78a-a949-48ff-84ed-14e83d82edb9 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381169
May 20 16:18:01.779248 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ea83962-2606-411f-9d31-3b5e43efed8c req-08a52bef-65f1-4ccc-9fd7-4f4ff760ea96 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:01.780777 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1ea83962-2606-411f-9d31-3b5e43efed8c req-08a52bef-65f1-4ccc-9fd7-4f4ff760ea96 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0807557
May 20 16:18:01.826794 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1ea83962-2606-411f-9d31-3b5e43efed8c req-90d83fb1-b65e-49d9-9e69-70e227b36545 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400927
May 20 16:18:02.220855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58630) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:02.340721 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:02.354629 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:02.358477 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Usage tracker for resource:security_group_rule and tenant:b100174a69db4549a806995fc4a10d86 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:02.361330 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:02.367342 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:02.447204 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:02.516871 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:02.524075 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2c188346-c099-4377-a40a-63f801b31049 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:02.564008 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=b100174a69db4549a806995fc4a10d86&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3420765
May 20 16:18:02.564842 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7a7c837-cbfc-4d07-9fa5-b79c6fc99320,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:02.566790 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 58636) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:02.567994 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:02.626477 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:02.656384 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:02.756777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:02.760719 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:02.773680 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7a7c837-cbfc-4d07-9fa5-b79c6fc99320,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:02.776702 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:02.778972 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:02.782844 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d7a7c837-cbfc-4d07-9fa5-b79c6fc99320 HTTP/1.1" status: 204  len: 168 time: 0.2149677
May 20 16:18:02.829921 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69533081-1696-41f2-81ff-e7cda22fb458 req-23a4ae1a-3ed2-4f84-9f77-4f8e6b544a90 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:02.831531 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-69533081-1696-41f2-81ff-e7cda22fb458 req-23a4ae1a-3ed2-4f84-9f77-4f8e6b544a90 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.0831039
May 20 16:18:02.880009 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-69533081-1696-41f2-81ff-e7cda22fb458 req-6317e908-23c6-4ee9-b4ec-5b2d9894d977 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428209
May 20 16:18:03.054724 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68cba17-f6e2-42da-8c7d-57f2dbe13c46 req-eff09177-6380-4f1a-ae47-b4e969610600 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:03.056237 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e68cba17-f6e2-42da-8c7d-57f2dbe13c46 req-eff09177-6380-4f1a-ae47-b4e969610600 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0807855
May 20 16:18:03.101874 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e68cba17-f6e2-42da-8c7d-57f2dbe13c46 req-b0c85c65-2c83-467b-bde4-ddffb86b1aa4 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398109
May 20 16:18:03.497450 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 58658) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:03.515302 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:03.529767 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:03.533588 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Usage tracker for resource:security_group_rule and tenant:a2c18531d12b44979dacb68d3247da60 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:03.536428 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:03.542223 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:03.622015 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:03.693766 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:03.702994 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-48e6d92d-f9a1-4d58-9ac3-1ec8bea6bbe0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:03.743136 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=a2c18531d12b44979dacb68d3247da60&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2421472
May 20 16:18:03.743136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc774566-85bf-466c-80af-c88d7cafcb35,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:03.743550 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58662) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:03.745469 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:03.804697 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:03.830839 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:04.027996 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:04.037120 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-245045e0-78aa-4aa5-9d82-a4697e0126ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:04.051966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc774566-85bf-466c-80af-c88d7cafcb35,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:04.054281 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:04.080384 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:04.080828 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/dc774566-85bf-466c-80af-c88d7cafcb35 HTTP/1.1" status: 204  len: 168 time: 0.3359206
May 20 16:18:04.106876 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f18672-9d2c-4b66-8acf-8ca9926c3a24 req-1738decc-5b59-498e-ad63-47206c4fba2e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:04.109078 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98f18672-9d2c-4b66-8acf-8ca9926c3a24 req-1738decc-5b59-498e-ad63-47206c4fba2e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.1182761
May 20 16:18:04.159590 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98f18672-9d2c-4b66-8acf-8ca9926c3a24 req-c9281810-a04f-4975-9674-2656c7ed9a43 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446777
May 20 16:18:04.298891 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf349aa-dd32-4e05-bcb2-d9d150f6d4ef req-cd73a7e3-55b1-41e8-a23e-d84a0539604a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:04.300389 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-faf349aa-dd32-4e05-bcb2-d9d150f6d4ef req-cd73a7e3-55b1-41e8-a23e-d84a0539604a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0821834
May 20 16:18:04.345354 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-faf349aa-dd32-4e05-bcb2-d9d150f6d4ef req-ebdda65f-d6ea-40c4-9368-9e723cd73f89 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392308
May 20 16:18:05.418178 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430c4e21-5a5b-472c-bafb-7d2111de8752 req-aa013611-5594-4ee1-bfe1-b27f82b2e27f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:05.420904 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-430c4e21-5a5b-472c-bafb-7d2111de8752 req-aa013611-5594-4ee1-bfe1-b27f82b2e27f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.1484253
May 20 16:18:05.540960 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-430c4e21-5a5b-472c-bafb-7d2111de8752 req-33762812-15f3-4ad9-89ec-fc6600f02913 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1151826
May 20 16:18:05.578739 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3680257-83f0-48ee-af05-b7aecf9e77fb req-9351d440-5d01-45d4-85fb-af5a62aa2bd2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:05.580516 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3680257-83f0-48ee-af05-b7aecf9e77fb req-9351d440-5d01-45d4-85fb-af5a62aa2bd2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0997441
May 20 16:18:05.631891 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3680257-83f0-48ee-af05-b7aecf9e77fb req-e5cf04dd-5bc9-403f-9be5-0d3d818a60e5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449288
May 20 16:18:06.743661 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38557834-c4e0-4ecd-9fe3-8a34623cdd94 req-b14b45d5-108f-419d-a22d-5212780b0026 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:06.745178 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-38557834-c4e0-4ecd-9fe3-8a34623cdd94 req-b14b45d5-108f-419d-a22d-5212780b0026 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.0864196
May 20 16:18:06.793415 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-38557834-c4e0-4ecd-9fe3-8a34623cdd94 req-9b765c7e-9828-49d4-a348-dfee97ed8a7e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400374
May 20 16:18:06.970675 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10c86ed-dcc7-4604-9031-f87ae799f9f0 req-d44c5b88-2179-48d0-b4c1-783496ec245a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:06.972180 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a10c86ed-dcc7-4604-9031-f87ae799f9f0 req-d44c5b88-2179-48d0-b4c1-783496ec245a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0840993
May 20 16:18:07.019490 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a10c86ed-dcc7-4604-9031-f87ae799f9f0 req-791d865c-ec43-459b-a6a5-ce98e0441e92 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414877
May 20 16:18:07.976179 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-328c1602-1340-4aee-ba46-0c6ba3f0e92f req-1e400e69-2b67-42d6-bdf1-39dde3a84dc6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:07.977554 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-328c1602-1340-4aee-ba46-0c6ba3f0e92f req-1e400e69-2b67-42d6-bdf1-39dde3a84dc6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 943 time: 0.0795133
May 20 16:18:08.025252 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-328c1602-1340-4aee-ba46-0c6ba3f0e92f req-084fb17f-a093-4dc7-827b-d942afea1c06 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419600
May 20 16:18:08.205528 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ca72ee4-3efd-4ddc-9485-db3fc58506ec req-340b923c-af7c-46fa-a133-15bb3fde2cf8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:08.207098 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ca72ee4-3efd-4ddc-9485-db3fc58506ec req-340b923c-af7c-46fa-a133-15bb3fde2cf8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0808866
May 20 16:18:08.254977 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ca72ee4-3efd-4ddc-9485-db3fc58506ec req-289b6776-00ff-43d5-867e-83eba09fcac5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407093
May 20 16:18:08.568093 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device aa3b98da-a0e8-4ea3-81bb-be3921b39120 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:18:08.704926 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port aa3b98da-a0e8-4ea3-81bb-be3921b39120, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=aa3b98da-a0e8-4ea3-81bb-be3921b39120,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:08.718499 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'port_id': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', 'mac_address': 'fa:16:3e:27:a0:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 608, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '924a520e-53e5-4777-beb9-f9e6d0bd0dff', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:18:08.776483 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:08.793375 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa3b98da-a0e8-4ea3-81bb-be3921b39120 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:18:08.810496 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port aa3b98da-a0e8-4ea3-81bb-be3921b39120, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=aa3b98da-a0e8-4ea3-81bb-be3921b39120,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:08.888510 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:08.890297 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:08.963955 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:18:08.984953 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=aa3b98da-a0e8-4ea3-81bb-be3921b39120,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:08.992226 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.992581 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.992912 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.993233 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.993549 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.993866 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.994175 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.994484 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.994796 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.995105 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.995441 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.995748 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:08.999625 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:09.213777 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7aa1fe-86b2-403e-9bd7-98a615e02f76 req-aecaa1b6-64ed-442e-9329-cee59d2c4d5a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:09.215269 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ad7aa1fe-86b2-403e-9bd7-98a615e02f76 req-aecaa1b6-64ed-442e-9329-cee59d2c4d5a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 944 time: 0.0833414
May 20 16:18:09.262101 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ad7aa1fe-86b2-403e-9bd7-98a615e02f76 req-fe521b51-de6a-4739-a308-0353c29ba912 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404482
May 20 16:18:09.438330 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a502a6-82d7-4ca0-99f3-4e86bccb851b req-5721ba31-1ccf-4ec9-981f-b9798a91af31 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:09.439796 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-18a502a6-82d7-4ca0-99f3-4e86bccb851b req-5721ba31-1ccf-4ec9-981f-b9798a91af31 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0801036
May 20 16:18:09.486526 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-18a502a6-82d7-4ca0-99f3-4e86bccb851b req-f522f2cb-e14c-4bc4-8dd6-b88233d08224 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410550
May 20 16:18:10.456211 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b90f03-1cef-4024-b243-a8839a21309c req-bd9c5a27-109a-43e0-91ef-cf1dbbcf943d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:10.457690 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8b90f03-1cef-4024-b243-a8839a21309c req-bd9c5a27-109a-43e0-91ef-cf1dbbcf943d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 944 time: 0.0801730
May 20 16:18:10.502356 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8b90f03-1cef-4024-b243-a8839a21309c req-01a9fd9d-2c28-484c-8310-640dccdce801 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388808
May 20 16:18:10.681966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c51c18-112e-4482-8e08-4702dc8f180c req-1a85c27f-6f58-4c2e-aaae-f76e93a2fc95 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:10.683464 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-28c51c18-112e-4482-8e08-4702dc8f180c req-1a85c27f-6f58-4c2e-aaae-f76e93a2fc95 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0844624
May 20 16:18:10.732227 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-28c51c18-112e-4482-8e08-4702dc8f180c req-92c1d6f4-c1a8-4a55-8a23-3e913cce9af1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424097
May 20 16:18:11.689584 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94409d11-0e59-44cc-aaf3-75ecc00f4773 req-83112e2d-d95f-4cc0-ae25-54a2f6030a0a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:11.691105 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-94409d11-0e59-44cc-aaf3-75ecc00f4773 req-83112e2d-d95f-4cc0-ae25-54a2f6030a0a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 944 time: 0.0796354
May 20 16:18:11.736458 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-94409d11-0e59-44cc-aaf3-75ecc00f4773 req-cc3a68d7-61e4-450b-9dfa-798680840fe4 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394468
May 20 16:18:11.927470 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5e2fbf2-42a8-49cb-bf9a-31ac0dbe8474 req-c4851565-e728-4c5c-8470-6be8442db38a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:11.928898 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b5e2fbf2-42a8-49cb-bf9a-31ac0dbe8474 req-c4851565-e728-4c5c-8470-6be8442db38a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0826099
May 20 16:18:11.973621 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b5e2fbf2-42a8-49cb-bf9a-31ac0dbe8474 req-fc7d1741-12fc-4984-981b-9c303e6af18c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387402
May 20 16:18:12.117922 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['aa3b98da-a0e8-4ea3-81bb-be3921b39120'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:18:12.936375 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f12698-930a-4c3a-98d9-3ce69baabf79 req-750bae27-f3fa-451a-abd3-98f9d930e7a7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:12.937820 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98f12698-930a-4c3a-98d9-3ce69baabf79 req-750bae27-f3fa-451a-abd3-98f9d930e7a7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 944 time: 0.0899825
May 20 16:18:12.985216 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98f12698-930a-4c3a-98d9-3ce69baabf79 req-bfeea7fd-b563-43d6-99e7-a61fda2292ed tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413680
May 20 16:18:13.167047 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d42fb1cf-b806-4aab-aae3-280f54eed7c2 req-14ffac21-ccc2-4baf-b991-cfad28d11ce3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:13.168750 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d42fb1cf-b806-4aab-aae3-280f54eed7c2 req-14ffac21-ccc2-4baf-b991-cfad28d11ce3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0852571
May 20 16:18:13.229467 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d42fb1cf-b806-4aab-aae3-280f54eed7c2 req-ae76200a-a64c-48ba-a7e4-158bc6a8aca5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513587
May 20 16:18:14.177979 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e51e79a-46a5-4e12-8f18-4f3b1e1675e8 req-bce24bf4-a0aa-46ba-91e5-3429d417de3d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:14.183381 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6e51e79a-46a5-4e12-8f18-4f3b1e1675e8 req-bce24bf4-a0aa-46ba-91e5-3429d417de3d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 944 time: 0.0856464
May 20 16:18:14.228626 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6e51e79a-46a5-4e12-8f18-4f3b1e1675e8 req-78bbe211-ddd3-4e76-a4bf-71a884ee035a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428598
May 20 16:18:14.257501 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device aa3b98da-a0e8-4ea3-81bb-be3921b39120 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:18:14.447838 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519f1df4-dd85-4f42-a062-64788521a0ac req-26e81572-1270-4ce2-a64b-2e8020b99454 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:14.449225 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-519f1df4-dd85-4f42-a062-64788521a0ac req-26e81572-1270-4ce2-a64b-2e8020b99454 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0849175
May 20 16:18:14.494797 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-519f1df4-dd85-4f42-a062-64788521a0ac req-a0933d4e-ab77-42bc-9d20-57923efbb9cd tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398679
May 20 16:18:14.505509 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port aa3b98da-a0e8-4ea3-81bb-be3921b39120 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:18:14.513182 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port aa3b98da-a0e8-4ea3-81bb-be3921b39120 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:18:14.514271 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:14.642436 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:14.669667 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:18:14.680057 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port aa3b98da-a0e8-4ea3-81bb-be3921b39120, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=aa3b98da-a0e8-4ea3-81bb-be3921b39120,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:14.698204 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c31b4db-bd13-4851-83e0-c135ecd30e16 req-9cbd9c73-ec79-4c7b-b3e8-2dab26861a2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:14.700647 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8c31b4db-bd13-4851-83e0-c135ecd30e16 req-9cbd9c73-ec79-4c7b-b3e8-2dab26861a2a service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 1099 time: 0.0770717
May 20 16:18:14.717258 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', 'code': 200}
May 20 16:18:14.756902 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-8c31b4db-bd13-4851-83e0-c135ecd30e16 req-6dbffc08-4a4a-40e4-b8e0-550acda36f1d service neutron] Synchronizing usage tracker for tenant:571ccf58d8ca41d5997781f43472b617 on resource:security_group {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:18:14.813971 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:14.815901 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:14.843762 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58912) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:14.891813 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=aa3b98da-a0e8-4ea3-81bb-be3921b39120,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:14.894932 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:14.911343 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-8c31b4db-bd13-4851-83e0-c135ecd30e16 req-6dbffc08-4a4a-40e4-b8e0-550acda36f1d service neutron] Unset dirty status for tenant:571ccf58d8ca41d5997781f43472b617 on resource:security_group {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:18:14.912712 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8c31b4db-bd13-4851-83e0-c135ecd30e16 req-6dbffc08-4a4a-40e4-b8e0-550acda36f1d service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2024546
May 20 16:18:14.965503 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:14.996335 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:15.000989 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Usage tracker for resource:security_group_rule and tenant:04c3987909f045ea8b3feaefd75f63e7 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:15.004354 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:15.011195 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:15.111005 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:15.276886 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c532e3-91a8-4d52-bf28-4e655276e51a req-aec3e340-73fe-47fa-b215-fedf8a6f56e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:15.278378 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-86c532e3-91a8-4d52-bf28-4e655276e51a req-aec3e340-73fe-47fa-b215-fedf8a6f56e7 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 1098 time: 0.0744169
May 20 16:18:15.322165 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:15.329719 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-86c532e3-91a8-4d52-bf28-4e655276e51a req-f4f2c8f3-1716-4e16-8485-e50e4da4b2bb service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440323
May 20 16:18:15.336830 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d337ad7a-145b-4cd6-8e85-47e73d4186c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:15.417442 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=04c3987909f045ea8b3feaefd75f63e7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5725875
May 20 16:18:15.420567 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58930) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:15.423379 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3e16b61-428e-4804-a3c7-069ca61a80fc,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:15.434271 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:15.514378 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea6e0ba-1499-4532-a40b-56ad0f4647cc req-21eb1a46-b0a4-453c-9deb-732332c33a7c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:15.515293 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4ea6e0ba-1499-4532-a40b-56ad0f4647cc req-21eb1a46-b0a4-453c-9deb-732332c33a7c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 945 time: 0.1630509
May 20 16:18:15.608479 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:15.688626 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4ea6e0ba-1499-4532-a40b-56ad0f4647cc req-d1873fa4-be68-4877-b85c-65acd7fb7a26 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1657248
May 20 16:18:15.696047 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:15.768428 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c7e3f1-73bc-40fd-8644-4f7afd9915c6 req-57b2ada5-6ec9-4104-9f2c-907dfe6fa357 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:15.770070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f5c7e3f1-73bc-40fd-8644-4f7afd9915c6 req-57b2ada5-6ec9-4104-9f2c-907dfe6fa357 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1423404
May 20 16:18:15.821005 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f5c7e3f1-73bc-40fd-8644-4f7afd9915c6 req-57f79ed6-8526-429a-858a-359578536b6c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438302
May 20 16:18:15.906121 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:15.911386 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d3ec9b39-a1cc-4dfc-9eca-08e38059378d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:15.924042 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3e16b61-428e-4804-a3c7-069ca61a80fc,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:15.926398 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:15.929906 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:15.931174 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d3e16b61-428e-4804-a3c7-069ca61a80fc HTTP/1.1" status: 204  len: 168 time: 0.5095484
May 20 16:18:15.950958 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4b95c01f-7f9b-4f4a-aba3-c24228a1d627 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:16.886463 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 58982) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:16.922523 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:16.987821 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:16.998752 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Usage tracker for resource:security_group_rule and tenant:9d7db147e1aa42c296df7239b2028acd is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:17.003348 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:17.015077 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:17.043716 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5719b00-7786-423b-bd13-9af879ccc769 req-a55aa95c-fcc8-4103-bf84-3a9feb4f6f55 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:17.046114 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b5719b00-7786-423b-bd13-9af879ccc769 req-a55aa95c-fcc8-4103-bf84-3a9feb4f6f55 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 945 time: 0.2496321
May 20 16:18:17.127759 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b5719b00-7786-423b-bd13-9af879ccc769 req-6a5a66b8-e29a-44fd-97db-bf81f89deb9c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0687096
May 20 16:18:17.136977 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f5cb4a-d4d5-40d1-869b-6bd02e356112 req-15acb9a4-6ea6-451d-a128-91d042cf4d76 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:17.138919 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6f5cb4a-d4d5-40d1-869b-6bd02e356112 req-15acb9a4-6ea6-451d-a128-91d042cf4d76 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1943669
May 20 16:18:17.211291 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6f5cb4a-d4d5-40d1-869b-6bd02e356112 req-c491b6a3-8004-4cf5-9c58-45b372522d4d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0664215
May 20 16:18:17.226259 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:17.363376 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:17.376647 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cac407da-cbb2-4dc7-a401-b99ce58ffd50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:17.433120 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=9d7db147e1aa42c296df7239b2028acd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5448439
May 20 16:18:17.436501 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 58998) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:17.436978 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f823829-8f30-4566-bd25-2764f5edb69b,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:17.441269 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:17.473993 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c22261ed-7469-4835-be0b-071ca91048bc req-64178ee9-c4a5-40f3-b186-3d89aeaa3917 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:17.475500 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c22261ed-7469-4835-be0b-071ca91048bc req-64178ee9-c4a5-40f3-b186-3d89aeaa3917 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1522946
May 20 16:18:17.500788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:17.521188 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c22261ed-7469-4835-be0b-071ca91048bc req-2bf4addf-843d-4a26-87b4-21cc50162ed2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396419
May 20 16:18:17.527492 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:17.642402 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:17.652030 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b11cb300-132e-444f-883a-44ad834c602e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:17.661115 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f823829-8f30-4566-bd25-2764f5edb69b,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:17.671578 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:17.672913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:17.674663 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/9f823829-8f30-4566-bd25-2764f5edb69b HTTP/1.1" status: 204  len: 168 time: 0.2364683
May 20 16:18:18.324470 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d47f6d8-bcf2-45ca-8282-c717fc23610f req-4acdc9a6-d8dc-49ed-be24-04a2261d3a05 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:18.327397 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8d47f6d8-bcf2-45ca-8282-c717fc23610f req-4acdc9a6-d8dc-49ed-be24-04a2261d3a05 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 945 time: 0.0795746
May 20 16:18:18.375749 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8d47f6d8-bcf2-45ca-8282-c717fc23610f req-1017d244-1ee8-47ad-a7fd-8843af16010a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421484
May 20 16:18:18.505914 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:18.642610 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-bd0e6fe1-c45b-4d17-9650-7d88f98a9c54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:18.682588 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59038) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:18.711757 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:18.747127 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:18.752003 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Usage tracker for resource:security_group_rule and tenant:ae643a854e034a5dbce95b270e9502e5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:18.755121 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:18.762327 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:18.879507 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.031081 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.042973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:19.090680 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ae643a854e034a5dbce95b270e9502e5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4069736
May 20 16:18:19.094250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73e9f131-b380-45f9-8ee3-18d6db62909a,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:19.094504 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59056) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:19.098464 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:19.164850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.184615 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59060) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:19.193294 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.341705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59074) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:19.385061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.398493 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:19.400510 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.417733 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73e9f131-b380-45f9-8ee3-18d6db62909a,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:19.421000 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.422297 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/73e9f131-b380-45f9-8ee3-18d6db62909a HTTP/1.1" status: 204  len: 168 time: 0.3266389
May 20 16:18:19.423455 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:19.437775 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.448559 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:19.455572 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Usage tracker for resource:security_group_rule and tenant:0308f825e4314f82bd948ba4053c386f is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:19.459128 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:19.462041 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:19.468501 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:19.470744 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Usage tracker for resource:security_group_rule and tenant:ab03616f3bb544c08802913dc580a912 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:19.474466 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:19.500057 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:19.614541 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.668942 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.719053 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.779845 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.788291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9a7c0f44-6d73-4670-8fcc-bcb7073e7053 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:19.835666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:19.846261 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=0308f825e4314f82bd948ba4053c386f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6600459
May 20 16:18:19.849130 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59090) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:19.877996 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09153fe4-1550-4229-b1f6-40bf32ebc18e,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:19.884250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:19.884743 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1ac50b0f-133a-4081-8fb8-e52f6ef7786e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.033s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:19.900525 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59100) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:19.900781 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ab03616f3bb544c08802913dc580a912&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5577340
May 20 16:18:19.921634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0401589-6714-4212-b04e-86abb779535e,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:19.924780 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:19.983721 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.032256 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.062489 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.101971 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.231373 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.236550 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-dbe50f67-5a38-4bd4-ac2f-ccfd09119eb3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:20.249868 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09153fe4-1550-4229-b1f6-40bf32ebc18e,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:20.252490 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:20.261329 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.266161 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/09153fe4-1550-4229-b1f6-40bf32ebc18e HTTP/1.1" status: 204  len: 168 time: 0.4123492
May 20 16:18:20.299534 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.305596 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:20.305596 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/c0401589-6714-4212-b04e-86abb779535e HTTP/1.1" status: 204  len: 168 time: 0.4015174
May 20 16:18:20.305596 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:20.314008 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0401589-6714-4212-b04e-86abb779535e,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:20.316203 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:20.698978 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7a0c67-7487-47d2-9a79-96b3745c7a4b req-62ccd9f2-4128-4fc9-8fcf-d1d9715e83e0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:20.700947 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ea7a0c67-7487-47d2-9a79-96b3745c7a4b req-62ccd9f2-4128-4fc9-8fcf-d1d9715e83e0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0944805
May 20 16:18:20.750541 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7627144-197e-4750-9f61-71441d16d584 req-a53bb257-1757-4e37-926a-60e0fc88a374 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:20.752296 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-b7627144-197e-4750-9f61-71441d16d584 req-a53bb257-1757-4e37-926a-60e0fc88a374 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.0947282
May 20 16:18:20.805554 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ea7a0c67-7487-47d2-9a79-96b3745c7a4b req-5308eeaa-da57-4e4a-bb07-b0e788f85569 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0894759
May 20 16:18:20.913502 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7627144-197e-4750-9f61-71441d16d584 req-b527d381-f715-40b7-a775-4b643474b437 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:20.915023 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-b7627144-197e-4750-9f61-71441d16d584 req-b527d381-f715-40b7-a775-4b643474b437 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.1562600
May 20 16:18:20.999201 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-b7627144-197e-4750-9f61-71441d16d584 req-55454d51-d138-4a4a-afbf-e21c9fa28c16 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 217 time: 0.0768261
May 20 16:18:21.062749 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7627144-197e-4750-9f61-71441d16d584 req-aacb7d6f-9ec6-4a55-96e7-0c95a113ae2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:21.064300 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-b7627144-197e-4750-9f61-71441d16d584 req-aacb7d6f-9ec6-4a55-96e7-0c95a113ae2a service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0589194
May 20 16:18:21.114745 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-b7627144-197e-4750-9f61-71441d16d584 req-9d514939-6a73-46e0-a04b-f8bed473f84a service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0439653
May 20 16:18:21.311353 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-b7627144-197e-4750-9f61-71441d16d584 req-0573a14c-577a-4589-83c4-d7f1f63b37fa service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1904259
May 20 16:18:21.355882 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.433038 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59150) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:21.449652 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-b7627144-197e-4750-9f61-71441d16d584 req-8dc52f11-67cc-4911-b3da-942e29e8755a service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1320689
May 20 16:18:21.454764 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59156) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:21.473669 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.494371 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:21.498583 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Usage tracker for resource:security_group_rule and tenant:448524be1288489f868aa88dfdc75926 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:21.501578 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:21.507505 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:21.589935 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.627787 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-787475935-network', 'tenant_id': '685f156c43064dcf8880e8af97070ea9'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:21.638937 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:21.641689 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Usage tracker for resource:network and tenant:685f156c43064dcf8880e8af97070ea9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:21.647174 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:21.655769 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:21.662229 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.676312 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:21.728201 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59168) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:21.739245 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=448524be1288489f868aa88dfdc75926&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2695515
May 20 16:18:21.739245 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44246eae-1867-4725-b03b-332839bcf0ec,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:21.751796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:21.803247 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.819959 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Made reservation on behalf of 685f156c43064dcf8880e8af97070ea9 for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:21.821910 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.837774 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.845417 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:21.892528 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:21.900373 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Usage tracker for resource:security_group_rule and tenant:685f156c43064dcf8880e8af97070ea9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:21.919381 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:21.926495 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:21.992080 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.001114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a3af14b1-dfb9-48c6-9b8a-4cccfe00cb61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:22.017270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44246eae-1867-4725-b03b-332839bcf0ec,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:22.026562 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:22.069815 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.071448 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/44246eae-1867-4725-b03b-332839bcf0ec HTTP/1.1" status: 204  len: 168 time: 0.3418460
May 20 16:18:22.242540 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c841fda5-adc3-47e1-8b68-3c89d41bc490 req-7af2a16f-f7f8-4990-945e-70e1429d53a6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:22.244021 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c841fda5-adc3-47e1-8b68-3c89d41bc490 req-7af2a16f-f7f8-4990-945e-70e1429d53a6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.2569473
May 20 16:18:22.343741 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.347040 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c841fda5-adc3-47e1-8b68-3c89d41bc490 req-55db6303-2226-4b09-8f65-91c0008f25ed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0950963
May 20 16:18:22.354684 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-a1a4dfcb-d9b0-4b24-98ff-546bb608e602 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:22.356121 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-a1a4dfcb-d9b0-4b24-98ff-546bb608e602 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.2394385
May 20 16:18:22.378254 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-076770bb-88ec-45b5-8de7-851722b321fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/quotas/747fc4332771467fa24e6bc07899b54f HTTP/1.1" status: 200  len: 375 time: 0.0100863
May 20 16:18:22.454063 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.458787 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-36402cf0-aa1a-46fd-88ba-f85010840a6d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:22.489106 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] vlan segment allocate from pool success with {'vlan_id': 639, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:18:22.512346 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-773dbe18-cb88-47dc-8f59-f37341b4a35f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1283917
May 20 16:18:22.539061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ea187d4-f820-42b0-b9c6-b541013c8cb4,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:22.550790 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:22.557798 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.558115 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Added segment d381c96c-d9a4-4090-b7b0-51fe6ac531dd of type vlan for network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca
May 20 16:18:22.713181 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.754611 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-48cc9638-e179-4d59-a874-612f3e051977 service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2415788
May 20 16:18:22.846953 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.852728 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:22.853511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:22.860480 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:22.996353 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Pushing event updated for resources: {'Network': ['ID=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:23.000107 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-7ad3d9eb-31f2-4aac-9e51-8a1e709fdafb service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2393024
May 20 16:18:23.000850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:23.015864 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:18:23.417116 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 1.9807115
May 20 16:18:23.417414 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59240) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:23.425494 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Request body: {'subnet': {'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-787475935-subnet', 'tenant_id': '685f156c43064dcf8880e8af97070ea9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:23.433831 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:23.437917 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Usage tracker for resource:subnet and tenant:685f156c43064dcf8880e8af97070ea9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:23.440851 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:23.446953 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:23.565418 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1758424e-1368-4916-a26e-1773a53c7784 req-2e120ac1-05b7-4016-9ed2-2f1c5b2f78e5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:23.575131 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1758424e-1368-4916-a26e-1773a53c7784 req-2e120ac1-05b7-4016-9ed2-2f1c5b2f78e5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1141367
May 20 16:18:23.674231 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1758424e-1368-4916-a26e-1773a53c7784 req-f3078190-39de-418c-a231-1ec6e2667e14 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0974095
May 20 16:18:23.675285 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Made reservation on behalf of 685f156c43064dcf8880e8af97070ea9 for: {'subnet': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:23.680597 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6029181'] for subnet, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:23.744377 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-479b3015-2501-493d-b1dc-574dc48093b2 req-f287d8c3-71dc-47b6-bc41-7d0a7c6cd331 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.1213434
May 20 16:18:24.371233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6100820', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6029167'] for subnet, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:24.376527 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-8de93e40-c828-4cdf-8a3b-606892bcf37d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:24.458688 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Checking segment: {'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:18:24.458912 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Network hostable DHCP agents. Network: 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92421) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:18:24.464419 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Pushing event updated for resources: {'Subnet': ['ID=a138ecac-0095-4014-bd32-91dbb855f1d1,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:24.467263 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:24.624998 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92421) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:18:24.768601 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca) {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:18:24.780373 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b693035-f7d2-45ad-8f3b-ff5383cc4f66 None None] Network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:18:24.872761 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:24.873354 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:24.891853 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2b31e190-24f7-4ebe-b5af-e6531ccd0a35 req-637ad59a-e74b-4602-b28d-fa8c7c920e14 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0743742
May 20 16:18:24.946839 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fadb733-d039-426e-8a88-d620055764a7 req-72fc8ea4-6aa7-4d8a-8745-cf6b1e2a1e68 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:24.948849 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8fadb733-d039-426e-8a88-d620055764a7 req-72fc8ea4-6aa7-4d8a-8745-cf6b1e2a1e68 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1772656
May 20 16:18:24.988971 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85c851e6-eaf2-4190-8bd1-d19041e5e1d3 None None] Network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:18:25.000167 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8fadb733-d039-426e-8a88-d620055764a7 req-1b49cc15-fb8d-455c-8288-77d0a09bc617 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448895
May 20 16:18:25.142024 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e661d587-a60a-45ea-b465-81600aea6d7d admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.7213621
May 20 16:18:26.051906 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d45c32a4-d839-4cde-81c2-58b2721eebea req-2e7ccd0e-5962-4e6c-ab4b-6f36320a4903 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0506065
May 20 16:18:26.188079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11df8c2f-e1aa-445c-9e12-dab04f508358 req-0236e9b8-5147-44e3-88df-9349a4c8a64a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:26.189555 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-11df8c2f-e1aa-445c-9e12-dab04f508358 req-0236e9b8-5147-44e3-88df-9349a4c8a64a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0801911
May 20 16:18:26.236192 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-11df8c2f-e1aa-445c-9e12-dab04f508358 req-31ba3e13-fb34-4f04-bf0d-62ffc836fca7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405991
May 20 16:18:26.830200 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-8ac24627-1b35-484f-8e12-5fbcc5817365 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:26.831720 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-8ac24627-1b35-484f-8e12-5fbcc5817365 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.1587200
May 20 16:18:26.855253 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Request body: {'port': {'device_id': '40273433-6605-47d8-b622-2f20548a035e', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'admin_state_up': True, 'tenant_id': '747fc4332771467fa24e6bc07899b54f'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:27.000166 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:27.004464 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Usage tracker for resource:port and tenant:747fc4332771467fa24e6bc07899b54f is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:27.007507 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:27.013911 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:27.173600 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Made reservation on behalf of 747fc4332771467fa24e6bc07899b54f for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:27.177233 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:27.211907 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19eea835-13aa-4fbb-be8f-ab7cd0aa3f70 req-28d9de4c-7367-4a8e-9006-969a560e4c46 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0474784
May 20 16:18:27.378909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Allocated IP 172.20.0.3 (7250e4c3-f4ff-4878-8316-65dfc0975bd3/924a520e-53e5-4777-beb9-f9e6d0bd0dff/5948d4d9-4307-4294-a458-260cc0b0d3d4) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:18:27.434031 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fda1f31-a418-441b-9a92-fa14cb6b07c7 req-b4a815c0-ae63-4066-8132-e039ccac3259 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:27.435626 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7fda1f31-a418-441b-9a92-fa14cb6b07c7 req-b4a815c0-ae63-4066-8132-e039ccac3259 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0816240
May 20 16:18:27.482753 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7fda1f31-a418-441b-9a92-fa14cb6b07c7 req-acd1c832-9869-4cc8-9416-14fb025b2528 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411851
May 20 16:18:27.586253 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:27.700080 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:27.706578 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:27.715632 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f', 'aa3b98da-a0e8-4ea3-81bb-be3921b39120'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:18:27.780021 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:18:27.783493 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:18:27.787768 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:18:27.820025 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event updated for resources: {'Port': ['ID=5948d4d9-4307-4294-a458-260cc0b0d3d4,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:27.834322 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:27.869136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:27.869801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:27.963994 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1125214
May 20 16:18:27.981006 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Request body: {'port': {'device_id': '40273433-6605-47d8-b622-2f20548a035e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:28.120548 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:28.439724 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59374) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:28.449614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c496d9e-6e93-4ce8-80e1-ea932f6edb00 req-def5710f-fd69-48b9-8771-86aa8508f590 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:28.451504 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6c496d9e-6e93-4ce8-80e1-ea932f6edb00 req-def5710f-fd69-48b9-8771-86aa8508f590 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 931 time: 0.1262820
May 20 16:18:28.503081 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5948d4d9-4307-4294-a458-260cc0b0d3d4 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:18:28.511024 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6c496d9e-6e93-4ce8-80e1-ea932f6edb00 req-323f9423-8e59-4540-92d8-d3241d48ba16 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528560
May 20 16:18:28.511738 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:28.520527 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:28.533829 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Transition to ACTIVE for port object 5948d4d9-4307-4294-a458-260cc0b0d3d4 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:18:28.616960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:28.622294 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:28.660198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:28.680725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9b62f9-8dc7-4dd4-b4e7-021d495f9fec req-27480f41-53cf-4435-9ed0-ddb715ad892d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:28.682242 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6e9b62f9-8dc7-4dd4-b4e7-021d495f9fec req-27480f41-53cf-4435-9ed0-ddb715ad892d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0851946
May 20 16:18:28.731255 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6e9b62f9-8dc7-4dd4-b4e7-021d495f9fec req-b2f93505-d753-43af-b6c4-a8d6c63b61d1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430264
May 20 16:18:28.836588 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:28.848810 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Usage tracker for resource:security_group_rule and tenant:021ec17b2b9a4952aeb987b81338728e is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:28.879761 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:28.882406 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Pushing event updated for resources: {'Port': ['ID=5948d4d9-4307-4294-a458-260cc0b0d3d4,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:28.892662 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:28.919902 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:28.985764 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Attempting to bind port 5948d4d9-4307-4294-a458-260cc0b0d3d4 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:18:28.986189 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Attempting to bind port 5948d4d9-4307-4294-a458-260cc0b0d3d4 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:18:28.986407 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Attempting to bind port 5948d4d9-4307-4294-a458-260cc0b0d3d4 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:18:28.996038 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Port 5948d4d9-4307-4294-a458-260cc0b0d3d4 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:18:28.996360 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Attempting to bind port 5948d4d9-4307-4294-a458-260cc0b0d3d4 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:18:29.007085 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 18, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:18:29.007447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Checking segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:18:29.007825 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Bound using segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:18:29.008246 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Bound port: 5948d4d9-4307-4294-a458-260cc0b0d3d4, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:18:29.008585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.114318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.137685 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] For port 5948d4d9-4307-4294-a458-260cc0b0d3d4, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:18:29.140774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] For port 5948d4d9-4307-4294-a458-260cc0b0d3d4, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5948d4d9-4307-4294-a458-260cc0b0d3d4,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:18:29.212264 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.220399 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-06b4afad-ec03-4fa1-941d-9b472af5a628 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:29.221738 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cd25f5-b698-4576-b593-aadca899a471 req-f6cead01-3707-486a-9985-6ad01919cb4b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:29.222428 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a0cd25f5-b698-4576-b593-aadca899a471 req-f6cead01-3707-486a-9985-6ad01919cb4b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Synchronizing usage tracker for tenant:685f156c43064dcf8880e8af97070ea9 on resource:network {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:18:29.268617 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=021ec17b2b9a4952aeb987b81338728e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8278241
May 20 16:18:29.269657 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53823eae-2288-40a5-8949-3ffdd58e42fb,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:29.271516 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59402) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:29.273679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:29.281802 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.286354 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:29.327216 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a0cd25f5-b698-4576-b593-aadca899a471 req-f6cead01-3707-486a-9985-6ad01919cb4b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Unset dirty status for tenant:685f156c43064dcf8880e8af97070ea9 on resource:network {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:18:29.328398 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-f6cead01-3707-486a-9985-6ad01919cb4b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/networks?id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca HTTP/1.1" status: 200  len: 813 time: 0.3176939
May 20 16:18:29.332788 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.345605 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:29.346383 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.347795 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] 10.222.0.16 "PUT /v2.0/ports/5948d4d9-4307-4294-a458-260cc0b0d3d4 HTTP/1.1" status: 200  len: 1093 time: 1.3724239
May 20 16:18:29.348270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40273433-6605-47d8-b622-2f20548a035e', 'tag': '5948d4d9-4307-4294-a458-260cc0b0d3d4'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:18:29.363999 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-4274cca5-7792-4527-9381-3140aa3960be tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/quotas/685f156c43064dcf8880e8af97070ea9 HTTP/1.1" status: 200  len: 375 time: 0.0283828
May 20 16:18:29.368385 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.369620 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Pushing event updated for resources: {'Port': ['ID=5948d4d9-4307-4294-a458-260cc0b0d3d4,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:29.372878 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:29.429289 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-2b24c3b6-c1e2-4b14-a0c4-3bcab49253a7 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=685f156c43064dcf8880e8af97070ea9&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0543129
May 20 16:18:29.569692 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-27bf57d4-f151-4794-8b7d-c25bdf21a1a1 service neutron] 10.222.0.64 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1308172
May 20 16:18:29.662102 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.670783 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-aee03d30-3a56-4248-b6c6-1d135480b27a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:29.689566 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53823eae-2288-40a5-8949-3ffdd58e42fb,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:29.694723 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:29.699894 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:29.701567 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/53823eae-2288-40a5-8949-3ffdd58e42fb HTTP/1.1" status: 204  len: 168 time: 0.4290750
May 20 16:18:29.729011 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-41430677-bea4-4d48-ba1b-b345c81e5916 service neutron] 10.222.0.64 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1520839
May 20 16:18:29.942905 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40273433-6605-47d8-b622-2f20548a035e', 'tag': '5948d4d9-4307-4294-a458-260cc0b0d3d4', 'status': 'completed', 'code': 200}
May 20 16:18:30.105867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e033e997-b2f6-4f79-9269-8ae4c1107d82 req-19bbe22c-d7d8-4c38-ac10-3082c52b2695 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:30.107389 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e033e997-b2f6-4f79-9269-8ae4c1107d82 req-19bbe22c-d7d8-4c38-ac10-3082c52b2695 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 943 time: 0.0818417
May 20 16:18:30.156792 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e033e997-b2f6-4f79-9269-8ae4c1107d82 req-8752da78-2fa3-4e30-be60-edf11e9509fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435030
May 20 16:18:30.331648 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0a2149-fac8-413d-8585-d8b8fc585d4d req-2ce65d9a-3770-4af5-87b4-16cbb15350c7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:30.333150 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f0a2149-fac8-413d-8585-d8b8fc585d4d req-2ce65d9a-3770-4af5-87b4-16cbb15350c7 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0802836
May 20 16:18:30.379731 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f0a2149-fac8-413d-8585-d8b8fc585d4d req-a94edbc0-699d-4972-95dd-90d9c77be0ee tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404034
May 20 16:18:30.424272 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59430) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:30.443432 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:30.457987 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:30.461824 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Usage tracker for resource:security_group_rule and tenant:38a4fa5484b24048a0237edf41976c9b is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:30.464816 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:30.465597 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d88a3a40-8719-4a70-b5e8-bcd75855c91b req-41ddd09a-cdc2-4633-90b9-3e13d41b9ba2 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 210 time: 0.0452719
May 20 16:18:30.471160 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:30.555685 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:30.655399 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:30.677984 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e2faf3a5-3c7d-43da-a2a1-3b6545e5014b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:30.757356 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ae8e8e3-f7db-4f1f-bca9-4d90bb072285,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:30.762070 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:30.765624 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=38a4fa5484b24048a0237edf41976c9b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3398616
May 20 16:18:30.768233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59438) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:30.782877 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-1921f7c0-78c1-45ee-9403-2cb09a2b6113 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:30.784864 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-1921f7c0-78c1-45ee-9403-2cb09a2b6113 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 1096 time: 0.2009971
May 20 16:18:30.826914 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-860201a6-fea6-466d-a66e-9bf6beca36d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:30.852287 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-860201a6-fea6-466d-a66e-9bf6beca36d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:31.000725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-860201a6-fea6-466d-a66e-9bf6beca36d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:31.005631 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:31.016548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860201a6-fea6-466d-a66e-9bf6beca36d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ae8e8e3-f7db-4f1f-bca9-4d90bb072285,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:31.021115 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-860201a6-fea6-466d-a66e-9bf6beca36d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:31.023046 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-860201a6-fea6-466d-a66e-9bf6beca36d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:31.026851 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-860201a6-fea6-466d-a66e-9bf6beca36d7 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/3ae8e8e3-f7db-4f1f-bca9-4d90bb072285 HTTP/1.1" status: 204  len: 168 time: 0.2576454
May 20 16:18:31.361065 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c952c4dc-bf2f-4b87-9fe4-f17ba50a6ea8 req-fa285660-b548-4d5e-be6d-cde61c9d7d9f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:31.362636 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c952c4dc-bf2f-4b87-9fe4-f17ba50a6ea8 req-fa285660-b548-4d5e-be6d-cde61c9d7d9f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 943 time: 0.0853384
May 20 16:18:31.408323 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c952c4dc-bf2f-4b87-9fe4-f17ba50a6ea8 req-3f9ffbde-587b-4600-aa14-f4fee4729d81 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398188
May 20 16:18:31.583097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860c0562-1871-40be-9b1c-b2ed5cb8149a req-8a84444b-9e3e-46f8-9593-62f9e737f258 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:31.584563 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-860c0562-1871-40be-9b1c-b2ed5cb8149a req-8a84444b-9e3e-46f8-9593-62f9e737f258 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0786252
May 20 16:18:31.632076 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-860c0562-1871-40be-9b1c-b2ed5cb8149a req-4a9d81ac-fc34-49eb-ae63-207aa2e8ca07 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416129
May 20 16:18:31.765839 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7dde9b8a-d113-4b4d-af78-5ffee3a02083 req-5e230214-d032-4ba5-8630-45ade1e7cc4f tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 210 time: 0.0422189
May 20 16:18:31.809803 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59458) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:31.827137 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:31.841785 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:31.845540 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Usage tracker for resource:security_group_rule and tenant:54eb1fafbaa74efd90ed022b22a01bd6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:31.848301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:31.853888 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:31.932483 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:31.996642 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:32.003911 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a339052d-0a98-4c06-bbd5-9d2a1d0ee5cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:32.045360 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-20884724-e521-4031-a780-0b118db1304e admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=54eb1fafbaa74efd90ed022b22a01bd6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2344358
May 20 16:18:32.046245 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8524a618-023b-41f4-a952-285edd530faf,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:32.048020 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59464) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:32.049182 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:32.106324 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:32.131340 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:32.270617 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-5e03232a-54a4-45ac-ab19-32f675b64316 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5948d4d9-4307-4294-a458-260cc0b0d3d4 HTTP/1.1" status: 200  len: 217 time: 0.0621607
May 20 16:18:32.307992 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:32.319615 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-410432dc-1665-4dd3-8e62-55002099f2d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:32.343148 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8524a618-023b-41f4-a952-285edd530faf,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:32.351830 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:32.363796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-bf6dd5ff-cca7-4766-b715-5216e7ae98a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:32.364891 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-bf6dd5ff-cca7-4766-b715-5216e7ae98a2 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 200  len: 855 time: 0.0881953
May 20 16:18:32.366087 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:32.367966 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/8524a618-023b-41f4-a952-285edd530faf HTTP/1.1" status: 204  len: 168 time: 0.3183858
May 20 16:18:32.427871 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-3650bec2-1ea7-4e11-8b33-0dc9ff55ab80 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=7250e4c3-f4ff-4878-8316-65dfc0975bd3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0499945
May 20 16:18:32.564825 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-d7a415fb-1f1d-4891-b226-deda4391567b service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1308205
May 20 16:18:32.611208 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0530d7dd-4043-4ea6-b90e-b578033e3142 req-353a0af1-8c98-42b4-907b-5e2fb90e0cd5 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:32.613512 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0530d7dd-4043-4ea6-b90e-b578033e3142 req-353a0af1-8c98-42b4-907b-5e2fb90e0cd5 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 943 time: 0.0858729
May 20 16:18:32.668015 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0530d7dd-4043-4ea6-b90e-b578033e3142 req-6a9dc7eb-9aee-4806-a043-2db9de989206 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485265
May 20 16:18:32.852505 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6fb4ff21-69c5-4ab9-bd33-ed2a23793cdc req-0989aa6b-2cdb-4bf6-8f68-bc926aaa63ee service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1358945
May 20 16:18:32.854150 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d837ac-5b24-48b6-a194-c8ac901f14a7 req-787adb41-6e33-466d-9dd4-65b930aeb4f8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:32.854150 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-82d837ac-5b24-48b6-a194-c8ac901f14a7 req-787adb41-6e33-466d-9dd4-65b930aeb4f8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0897536
May 20 16:18:32.933086 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-82d837ac-5b24-48b6-a194-c8ac901f14a7 req-422ff040-00b9-4253-a594-d5ae36fcc6fc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0805943
May 20 16:18:32.933086 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4282bebc-b775-4921-90dd-9b63dbe8e1e9 req-3c331da4-311a-45ec-bd77-2b94a86f408a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 210 time: 0.0497434
May 20 16:18:33.054353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0864774f-452b-4b75-b598-3c73145b56ae req-c2299b73-4f0c-4de5-a54f-689bdc62af64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:33.055893 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0864774f-452b-4b75-b598-3c73145b56ae req-c2299b73-4f0c-4de5-a54f-689bdc62af64 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 1096 time: 0.0752544
May 20 16:18:33.201964 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0864774f-452b-4b75-b598-3c73145b56ae req-a42282b4-5669-42dd-a081-1c9272293cb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:33.205826 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0864774f-452b-4b75-b598-3c73145b56ae req-a42282b4-5669-42dd-a081-1c9272293cb3 service neutron] 10.222.0.16 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 916 time: 0.1399703
May 20 16:18:33.276974 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0864774f-452b-4b75-b598-3c73145b56ae req-b2714cba-4e83-41a3-bf49-8e35ce416bf5 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5948d4d9-4307-4294-a458-260cc0b0d3d4 HTTP/1.1" status: 200  len: 217 time: 0.0657525
May 20 16:18:33.343233 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0864774f-452b-4b75-b598-3c73145b56ae req-44179133-8e56-4366-8748-3bca1ad21cba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:33.344642 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0864774f-452b-4b75-b598-3c73145b56ae req-44179133-8e56-4366-8748-3bca1ad21cba service neutron] 10.222.0.16 "GET /v2.0/subnets?id=924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 200  len: 855 time: 0.0608027
May 20 16:18:33.392484 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0864774f-452b-4b75-b598-3c73145b56ae req-5a4f39e9-49f0-49e2-9fcd-8fa5e3f5e121 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=7250e4c3-f4ff-4878-8316-65dfc0975bd3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0405915
May 20 16:18:33.597079 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0864774f-452b-4b75-b598-3c73145b56ae req-5e221957-1cda-46ea-9f4b-b63bfa4f0cf2 service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1976264
May 20 16:18:33.751630 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0864774f-452b-4b75-b598-3c73145b56ae req-0765438c-4674-47e6-b184-f5e493dcc72b service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1264970
May 20 16:18:33.926070 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4e20ab-2990-46b7-bcfe-c98d57ebaa29 req-9b18bcde-b3bb-4f8c-be3b-b8babc16abc2 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:33.927723 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cc4e20ab-2990-46b7-bcfe-c98d57ebaa29 req-9b18bcde-b3bb-4f8c-be3b-b8babc16abc2 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 943 time: 0.0976310
May 20 16:18:34.058788 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cc4e20ab-2990-46b7-bcfe-c98d57ebaa29 req-ba67d61f-8f82-4f91-abdb-a2003e9084b1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1251292
May 20 16:18:34.248300 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52e95111-1dc4-453b-8ab9-99118c81befc req-0a9ffbd1-e2ef-4374-9a17-741c1ed08018 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 210 time: 0.0655971
May 20 16:18:34.286687 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5b17af-1354-4934-a864-e629b05af2d2 req-7f6777e9-5162-40f0-ad5f-ebc9271bc9dc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:34.297732 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-de5b17af-1354-4934-a864-e629b05af2d2 req-7f6777e9-5162-40f0-ad5f-ebc9271bc9dc tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.2408066
May 20 16:18:34.355324 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-de5b17af-1354-4934-a864-e629b05af2d2 req-1c2403a2-80f3-4ead-9a86-0086933cf429 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471809
May 20 16:18:34.484587 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cd25f5-b698-4576-b593-aadca899a471 req-c37d9cc3-b3ae-4a3e-9e91-f648bf6d2aa8 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:34.486796 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-c37d9cc3-b3ae-4a3e-9e91-f648bf6d2aa8 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "GET /v2.0/networks?id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca HTTP/1.1" status: 200  len: 813 time: 0.1961820
May 20 16:18:34.500733 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Request body: {'port': {'device_id': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca', 'admin_state_up': True, 'tenant_id': '685f156c43064dcf8880e8af97070ea9'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:34.658801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:34.660717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Usage tracker for resource:port and tenant:685f156c43064dcf8880e8af97070ea9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:34.667622 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:34.687791 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:34.778195 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Made reservation on behalf of 685f156c43064dcf8880e8af97070ea9 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:34.782557 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:34.911796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59554) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:35.002322 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Allocated IP 172.20.0.2 (3b4ff6d7-4fdf-4a00-84ee-540ff69761ca/a138ecac-0095-4014-bd32-91dbb855f1d1/82c98f0c-1ea5-462d-9be5-cd913e8b063c) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:18:35.261237 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.262434 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.280280 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:35.286998 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Usage tracker for resource:security_group_rule and tenant:3b2268a297074a12b91519ebe49af036 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:35.290853 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:35.303829 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:35.344356 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2edc7e17-887a-4876-84e5-f7f1fa3cdd6e req-bdb5627a-3777-481d-b4ea-eb9341ba0571 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:35.345845 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2edc7e17-887a-4876-84e5-f7f1fa3cdd6e req-bdb5627a-3777-481d-b4ea-eb9341ba0571 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 943 time: 0.1527827
May 20 16:18:35.429838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.442889 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:35.446039 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b5709da8-35eb-46b3-b360-ec691a6c168c req-e434c860-1e29-4479-91f2-2864f4e708da tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 210 time: 0.0664730
May 20 16:18:35.458834 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2edc7e17-887a-4876-84e5-f7f1fa3cdd6e req-cda07ffd-8429-4c37-b7a3-a92240c9075b tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1066966
May 20 16:18:35.527286 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.547656 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:18:35.550938 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:18:35.555006 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:18:35.595868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Pushing event updated for resources: {'Port': ['ID=82c98f0c-1ea5-462d-9be5-cd913e8b063c,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:35.604279 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:35.626326 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:35.626970 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.630622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.639973 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:35.692595 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=3b2268a297074a12b91519ebe49af036&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7790923
May 20 16:18:35.693449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7ac4b40-ac6f-434f-913d-563eb3b7b710,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:35.695364 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59592) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:35.697847 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:35.723866 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d71678c-a0f4-4014-a745-87d20b4de3bd req-dd423500-548e-4216-b01b-bf8787b288bb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:35.723866 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0d71678c-a0f4-4014-a745-87d20b4de3bd req-dd423500-548e-4216-b01b-bf8787b288bb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1379058
May 20 16:18:35.765997 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2698839
May 20 16:18:35.767167 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.780887 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0d71678c-a0f4-4014-a745-87d20b4de3bd req-609372bd-45dc-42c6-ac32-927c58669a5b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0529416
May 20 16:18:35.785264 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Request body: {'port': {'device_id': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:35.855128 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:35.949232 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.193809 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59614) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:36.249716 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.261986 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e6887d47-9086-44cd-9c63-ee8b7517a6cf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:36.282748 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7ac4b40-ac6f-434f-913d-563eb3b7b710,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:36.289658 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56366c4-bce5-406d-b1da-d768e1242028 req-d0cf3529-18cf-4adb-9b01-e7a641f3b0ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:36.291061 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e56366c4-bce5-406d-b1da-d768e1242028 req-d0cf3529-18cf-4adb-9b01-e7a641f3b0ab service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.2277086
May 20 16:18:36.291931 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:36.299310 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.300385 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/e7ac4b40-ac6f-434f-913d-563eb3b7b710 HTTP/1.1" status: 204  len: 168 time: 0.6040249
May 20 16:18:36.351422 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.359702 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e56366c4-bce5-406d-b1da-d768e1242028 req-b7f1380e-a231-45ef-b179-20c26f4e8d98 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0581093
May 20 16:18:36.369630 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:36.374697 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Usage tracker for resource:security_group_rule and tenant:ae377189904e43d48da055bbbd7e7c3f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:36.377554 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:36.383670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:36.432752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 82c98f0c-1ea5-462d-9be5-cd913e8b063c {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:18:36.440557 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.455604 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Transition to ACTIVE for port object 82c98f0c-1ea5-462d-9be5-cd913e8b063c will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:18:36.469402 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.625310 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.630796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2175f610-47e8-44e6-b659-e9c03fa882cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:36.665002 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.674322 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a74ba045-0fc7-4e1e-8460-f875fae9a869 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:36.743885 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ae377189904e43d48da055bbbd7e7c3f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5360477
May 20 16:18:36.752085 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59632) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:36.752085 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca9351b0-2869-48f9-b82f-b2a14c532316,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:36.771152 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:36.820783 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282aeff3-97af-4287-86d9-444d40c6afe0 req-655a6821-d282-43fb-9b47-7d0edf2dc6ec tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:36.822439 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-282aeff3-97af-4287-86d9-444d40c6afe0 req-655a6821-d282-43fb-9b47-7d0edf2dc6ec tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 943 time: 0.2470973
May 20 16:18:36.842125 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5747a1-999a-4b45-9962-03f1a2b48faf req-7b87175a-6360-4e2c-bbdb-dbd5b996a971 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:36.843685 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b5747a1-999a-4b45-9962-03f1a2b48faf req-7b87175a-6360-4e2c-bbdb-dbd5b996a971 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 943 time: 0.2315238
May 20 16:18:36.874821 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Pushing event updated for resources: {'Port': ['ID=82c98f0c-1ea5-462d-9be5-cd913e8b063c,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:36.882414 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:36.916669 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.958196 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-282aeff3-97af-4287-86d9-444d40c6afe0 req-2def957e-4284-4e9b-aed8-fbb70ab3efa0 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1246018
May 20 16:18:36.982835 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-7b5747a1-999a-4b45-9962-03f1a2b48faf req-c552e6af-35f7-4d6b-87b1-b818009e9ca1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Synchronizing usage tracker for tenant:685f156c43064dcf8880e8af97070ea9 on resource:security_group {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:18:36.986646 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:36.996848 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Attempting to bind port 82c98f0c-1ea5-462d-9be5-cd913e8b063c on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:18:36.998017 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Attempting to bind port 82c98f0c-1ea5-462d-9be5-cd913e8b063c by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:18:36.998405 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Attempting to bind port 82c98f0c-1ea5-462d-9be5-cd913e8b063c on network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:18:37.006447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Port 82c98f0c-1ea5-462d-9be5-cd913e8b063c on network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:18:37.006779 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Attempting to bind port 82c98f0c-1ea5-462d-9be5-cd913e8b063c on network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:18:37.015525 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 18, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:18:37.016683 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Checking segment: {'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:18:37.017077 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Bound using segment: {'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:18:37.017514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Bound port: 82c98f0c-1ea5-462d-9be5-cd913e8b063c, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:18:37.017866 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.117536 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] For port 82c98f0c-1ea5-462d-9be5-cd913e8b063c, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:18:37.120583 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] For port 82c98f0c-1ea5-462d-9be5-cd913e8b063c, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=82c98f0c-1ea5-462d-9be5-cd913e8b063c,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:18:37.166079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616d3dbd-d7da-4f44-979d-0ab3935222fd req-1edd4b12-4036-47e2-b4c8-b9766e140015 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:37.167623 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-616d3dbd-d7da-4f44-979d-0ab3935222fd req-1edd4b12-4036-47e2-b4c8-b9766e140015 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0842984
May 20 16:18:37.216674 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-616d3dbd-d7da-4f44-979d-0ab3935222fd req-ab1c901c-293f-46c8-984f-c9c4ba44a867 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425682
May 20 16:18:37.237889 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-7b5747a1-999a-4b45-9962-03f1a2b48faf req-c552e6af-35f7-4d6b-87b1-b818009e9ca1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Unset dirty status for tenant:685f156c43064dcf8880e8af97070ea9 on resource:security_group {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:18:37.239294 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b5747a1-999a-4b45-9962-03f1a2b48faf req-c552e6af-35f7-4d6b-87b1-b818009e9ca1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3791370
May 20 16:18:37.265485 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.276529 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d1b6a55b-99a4-4072-bea5-de83d3454091 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:37.289672 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca9351b0-2869-48f9-b82f-b2a14c532316,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:37.292288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:37.314789 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.316932 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/ca9351b0-2869-48f9-b82f-b2a14c532316 HTTP/1.1" status: 204  len: 168 time: 0.5669940
May 20 16:18:37.317484 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.330738 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1e1d9ba0-5937-483a-bcdf-53146cc6e822 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:37.395334 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:37.395933 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.397656 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] 10.222.0.16 "PUT /v2.0/ports/82c98f0c-1ea5-462d-9be5-cd913e8b063c HTTP/1.1" status: 200  len: 1093 time: 1.6198258
May 20 16:18:37.400477 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'tag': '82c98f0c-1ea5-462d-9be5-cd913e8b063c'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:18:37.423914 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Pushing event updated for resources: {'Port': ['ID=82c98f0c-1ea5-462d-9be5-cd913e8b063c,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:37.427056 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:37.441200 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59656) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:37.458105 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'tag': '82c98f0c-1ea5-462d-9be5-cd913e8b063c', 'status': 'completed', 'code': 200}
May 20 16:18:37.462480 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.478112 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:37.483650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Usage tracker for resource:security_group_rule and tenant:bb118fd1c6704a8d88c102feeb5773ee is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:37.486613 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:37.492542 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:37.610970 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5bb11c-f2ef-4711-8f24-ddaa894efa37 req-add6cdf1-278a-472e-b7cb-03287c7d51d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:37.612446 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bb5bb11c-f2ef-4711-8f24-ddaa894efa37 req-add6cdf1-278a-472e-b7cb-03287c7d51d6 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=685f156c43064dcf8880e8af97070ea9&device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 1096 time: 0.1120253
May 20 16:18:37.676623 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.777946 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5bb11c-f2ef-4711-8f24-ddaa894efa37 req-1a56fae2-48b5-4801-84f6-f24cd297770f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:37.779964 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bb5bb11c-f2ef-4711-8f24-ddaa894efa37 req-1a56fae2-48b5-4801-84f6-f24cd297770f service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=685f156c43064dcf8880e8af97070ea9&shared=False HTTP/1.1" status: 200  len: 914 time: 0.1566608
May 20 16:18:37.792181 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.818855 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-419155a5-36bd-44ec-83ac-6a3fe4691da9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:37.879375 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=bb118fd1c6704a8d88c102feeb5773ee&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4362411
May 20 16:18:37.881372 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59672) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:37.931044 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bcfbdba8-8df4-4d35-b512-3325324e5310,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:37.936134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:37.974962 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:37.984156 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5bb11c-f2ef-4711-8f24-ddaa894efa37 req-e020719a-bf44-4d8c-8a91-cc10e95eff12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:37.985664 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bb5bb11c-f2ef-4711-8f24-ddaa894efa37 req-e020719a-bf44-4d8c-8a91-cc10e95eff12 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1945000
May 20 16:18:38.005312 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.107566 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cd25f5-b698-4576-b593-aadca899a471 req-cc83b388-1cf1-404e-8806-8b5b65e22b59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:38.109396 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-cc83b388-1cf1-404e-8806-8b5b65e22b59 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=685f156c43064dcf8880e8af97070ea9&device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 1096 time: 0.0748601
May 20 16:18:38.173416 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb179d10-25f4-46dc-910e-122858b85d74 req-75d184be-d6be-4f68-abf9-9ebf79dfac5f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:38.175094 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cb179d10-25f4-46dc-910e-122858b85d74 req-75d184be-d6be-4f68-abf9-9ebf79dfac5f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 943 time: 0.0896814
May 20 16:18:38.190778 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-5b8f7ea0-a705-4c17-b384-e4ffefd7b146 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=82c98f0c-1ea5-462d-9be5-cd913e8b063c HTTP/1.1" status: 200  len: 217 time: 0.0685046
May 20 16:18:38.226603 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cb179d10-25f4-46dc-910e-122858b85d74 req-0093653d-7609-4c3f-af4f-3df09abfe6be tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439112
May 20 16:18:38.255898 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cd25f5-b698-4576-b593-aadca899a471 req-4ea2420a-a0c2-4f0d-ae6a-8cafa40d9dc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:38.257387 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-4ea2420a-a0c2-4f0d-ae6a-8cafa40d9dc5 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a138ecac-0095-4014-bd32-91dbb855f1d1 HTTP/1.1" status: 200  len: 853 time: 0.0650728
May 20 16:18:38.282272 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.288690 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-73092a6f-9f0a-4bb5-bd07-843b5870c6c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:38.305339 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bcfbdba8-8df4-4d35-b512-3325324e5310,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:38.308738 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:38.311286 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.314653 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/bcfbdba8-8df4-4d35-b512-3325324e5310 HTTP/1.1" status: 204  len: 168 time: 0.4321501
May 20 16:18:38.315448 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-0fdd606c-7631-48a1-a011-bf863be9974e service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0496502
May 20 16:18:38.339873 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59698) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:38.364608 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.418040 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5948d4d9-4307-4294-a458-260cc0b0d3d4 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:18:38.418683 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:38.443319 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Usage tracker for resource:security_group_rule and tenant:4bb964ae44ce499b89f15007f929babd is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:38.457908 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:38.495330 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-396185df-da80-4a7c-91dc-f2aa6be77047 service neutron] 10.222.0.16 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1677136
May 20 16:18:38.501727 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:38.604693 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 5948d4d9-4307-4294-a458-260cc0b0d3d4, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5948d4d9-4307-4294-a458-260cc0b0d3d4,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:38.608419 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81db3c0e-462c-42ca-8c8c-413f3ed559e5 req-c096453c-cdb3-4257-b5e6-ef4df475d441 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:38.609968 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-81db3c0e-462c-42ca-8c8c-413f3ed559e5 req-c096453c-cdb3-4257-b5e6-ef4df475d441 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.2134881
May 20 16:18:38.619809 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '5948d4d9-4307-4294-a458-260cc0b0d3d4', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'port_id': '5948d4d9-4307-4294-a458-260cc0b0d3d4', 'mac_address': 'fa:16:3e:ba:4b:96', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 608, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '924a520e-53e5-4777-beb9-f9e6d0bd0dff', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:18:38.652683 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e2c00f-8924-4a1f-ab67-4735578a4e41 req-7932e12c-ecbd-4d85-86c0-9c49a9b91e9e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:38.654755 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19e2c00f-8924-4a1f-ab67-4735578a4e41 req-7932e12c-ecbd-4d85-86c0-9c49a9b91e9e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 943 time: 0.2130480
May 20 16:18:38.683678 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a0cd25f5-b698-4576-b593-aadca899a471 req-db016805-f902-40de-81dd-6a32dc628839 service neutron] 10.222.0.16 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1806819
May 20 16:18:38.701107 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.728071 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5948d4d9-4307-4294-a458-260cc0b0d3d4 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:18:38.739394 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-81db3c0e-462c-42ca-8c8c-413f3ed559e5 req-e36cfb21-b3e3-4e3b-8db3-ea37cb8b8f84 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1192489
May 20 16:18:38.746592 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.756443 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19e2c00f-8924-4a1f-ab67-4735578a4e41 req-9707ed76-cf98-4577-8e4d-49149c6d76d3 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0897729
May 20 16:18:38.756625 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 5948d4d9-4307-4294-a458-260cc0b0d3d4, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5948d4d9-4307-4294-a458-260cc0b0d3d4,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:38.847971 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.848229 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:38.849892 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:38.856945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ddc241d6-2075-4f29-8d76-576e75f2fe10 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:38.890616 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b865655b-24e4-4ed9-a964-8412a580e573,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:38.933943 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.936517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.936517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.936517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.936517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.936517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.936975 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.936975 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.937197 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.937523 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.937845 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.938169 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:38.967339 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:38.967339 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=4bb964ae44ce499b89f15007f929babd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6228666
May 20 16:18:38.968958 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59726) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:38.977043 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=5948d4d9-4307-4294-a458-260cc0b0d3d4,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:38.990535 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:39.042525 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:39.074972 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:39.237373 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:39.244908 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e93e2a6b-eb4d-4de9-a6cf-6af1c0f7aef9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:39.279147 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:39.279147 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/b865655b-24e4-4ed9-a964-8412a580e573 HTTP/1.1" status: 204  len: 168 time: 0.3062589
May 20 16:18:39.284330 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b865655b-24e4-4ed9-a964-8412a580e573,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:39.292258 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:39.629438 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-ad585460-1e8f-4337-80de-fa2c10b3bb26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:39.630992 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-ad585460-1e8f-4337-80de-fa2c10b3bb26 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.1425281
May 20 16:18:39.634033 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16566530-6b9a-4dfd-b1e7-c8af968caf4b req-21912793-ba1c-47a2-a1a3-488daa1b15f6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:39.635650 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-16566530-6b9a-4dfd-b1e7-c8af968caf4b req-21912793-ba1c-47a2-a1a3-488daa1b15f6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 944 time: 0.2345214
May 20 16:18:39.644118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c1aec5-5500-46c9-b0cf-60168927d161 req-f541052c-e79c-4e25-9dc2-237848ee30b0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:39.645758 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-83c1aec5-5500-46c9-b0cf-60168927d161 req-f541052c-e79c-4e25-9dc2-237848ee30b0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1272931
May 20 16:18:39.717353 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['5948d4d9-4307-4294-a458-260cc0b0d3d4'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:18:39.718985 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-16566530-6b9a-4dfd-b1e7-c8af968caf4b req-fd4aece4-92f3-4f48-93ef-0ab3b5d323c8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0724590
May 20 16:18:39.723844 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-83c1aec5-5500-46c9-b0cf-60168927d161 req-96b50d93-0adc-486d-8449-06c67952a883 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0640173
May 20 16:18:39.978695 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-403b8cc4-e2b0-431f-935f-6c14ab774840 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:39.981045 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-403b8cc4-e2b0-431f-935f-6c14ab774840 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.3380966
May 20 16:18:40.096627 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-32f48be7-c2d0-48c4-a001-2f0c0b949a5b service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 217 time: 0.1036386
May 20 16:18:40.154346 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced25815-62a9-49ae-8707-155e9e033179 req-20a0034f-5bba-4354-9b94-23adc11da186 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:40.154346 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ced25815-62a9-49ae-8707-155e9e033179 req-20a0034f-5bba-4354-9b94-23adc11da186 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 943 time: 0.1320882
May 20 16:18:40.174272 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-be1acbb0-f90e-4d1a-a43c-5ee0223e6806 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:40.175816 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-be1acbb0-f90e-4d1a-a43c-5ee0223e6806 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0722897
May 20 16:18:40.181824 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59790) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:40.210476 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ced25815-62a9-49ae-8707-155e9e033179 req-08f0d181-5de4-4468-a085-734a6260cf1d tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0543087
May 20 16:18:40.239220 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-c1ad9703-4adc-4202-b7d0-3f322845c7ae service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0483212
May 20 16:18:40.331548 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-192157405-network', 'tenant_id': 'bfea173096cf4b509735ffd535193ea5'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:40.346012 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:40.358356 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Usage tracker for resource:network and tenant:bfea173096cf4b509735ffd535193ea5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:40.362617 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:40.371350 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:40.397346 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-5ab719dc-4fda-4cda-81fa-1c258a788c99 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1508515
May 20 16:18:40.535462 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-243a6f1f-45f9-44d0-93c5-ab89d01dc84d req-193928de-0775-459f-aeec-3e7477ad34f5 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1268871
May 20 16:18:40.550688 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Made reservation on behalf of bfea173096cf4b509735ffd535193ea5 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:40.552895 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.567173 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.582257 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:40.586141 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Usage tracker for resource:security_group_rule and tenant:bfea173096cf4b509735ffd535193ea5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:40.588990 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:40.600482 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:40.684157 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.785238 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.789664 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-09b3dcd7-a292-45b9-b57d-2a6684392779 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:40.818825 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] vlan segment allocate from pool success with {'vlan_id': 643, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:18:40.833550 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04045ca2-7857-4449-8fcc-f44af2699567,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:40.839997 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.840463 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Added segment 586db0b1-2bc2-4dce-8d66-88ecd6bc05d3 of type vlan for network ff8e44fb-6ead-46de-8521-764b50418880
May 20 16:18:40.849502 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.850001 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.850471 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.850913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.851382 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.851830 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.852265 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.852705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.853178 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.853735 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.854148 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.854574 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:18:40.868220 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:40.892019 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.942770 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59818) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:40.979478 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.980848 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:40.981953 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:40.991713 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:41.010426 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146e6750-a956-4e81-82fd-891741f04486 req-9d1f628d-4b1e-4546-8e1d-091189bdc072 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:41.017573 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-146e6750-a956-4e81-82fd-891741f04486 req-9d1f628d-4b1e-4546-8e1d-091189bdc072 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1239941
May 20 16:18:41.056664 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02a6448-cbf3-44fb-aad9-6763dc64bb81 req-3cb88ea0-5f73-4144-90dc-016e42638df7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:41.058425 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a02a6448-cbf3-44fb-aad9-6763dc64bb81 req-3cb88ea0-5f73-4144-90dc-016e42638df7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 944 time: 0.2070961
May 20 16:18:41.116649 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-146e6750-a956-4e81-82fd-891741f04486 req-cb1e5c78-fbee-4168-a7de-2d71a437ca0f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0854378
May 20 16:18:41.116992 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Pushing event updated for resources: {'Network': ['ID=ff8e44fb-6ead-46de-8521-764b50418880,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:41.118219 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:41.128009 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network ff8e44fb-6ead-46de-8521-764b50418880 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:18:41.141027 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a02a6448-cbf3-44fb-aad9-6763dc64bb81 req-1ec21414-aef7-4a9c-8e0f-2bc1eaa2ebd6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0601294
May 20 16:18:41.228475 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.253434 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:41.264170 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Usage tracker for resource:security_group_rule and tenant:73d589c046704977befeae00642a180f is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:41.275906 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59834) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:41.282067 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 1.0882010
May 20 16:18:41.284467 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:41.291828 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Request body: {'subnet': {'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-192157405-subnet', 'tenant_id': 'bfea173096cf4b509735ffd535193ea5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:41.298554 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:41.303314 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:41.312542 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Usage tracker for resource:subnet and tenant:bfea173096cf4b509735ffd535193ea5 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:41.320700 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:41.332080 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:41.420234 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.428931 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Made reservation on behalf of bfea173096cf4b509735ffd535193ea5 for: {'subnet': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:41.431249 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6029181'] for subnet, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.522028 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.530888 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b1848f6c-117f-4f65-b7c1-c735116d928a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:41.559744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4005266c-3fe1-4400-8c13-c76df531f9e7 req-45998e5a-1550-4538-9a03-e3c4d6ea487f tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:41.561270 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4005266c-3fe1-4400-8c13-c76df531f9e7 req-45998e5a-1550-4538-9a03-e3c4d6ea487f tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 943 time: 0.2061832
May 20 16:18:41.578334 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=73d589c046704977befeae00642a180f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6342809
May 20 16:18:41.579286 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00123a6a-c2fa-43d4-9613-3907da773784,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:41.581695 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59846) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:41.596130 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:41.669948 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4005266c-3fe1-4400-8c13-c76df531f9e7 req-a63e7317-9c33-40e9-9e6b-a765d6ddd70c tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1029181
May 20 16:18:41.680305 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.710984 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.876585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.881882 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-825051f2-99ba-443a-9f1b-74612d1758a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:41.894051 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00123a6a-c2fa-43d4-9613-3907da773784,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:41.896938 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:41.899632 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:41.900749 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/00123a6a-c2fa-43d4-9613-3907da773784 HTTP/1.1" status: 204  len: 168 time: 0.3066585
May 20 16:18:42.014528 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6100820', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6029167'] for subnet, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:42.019251 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:42.097766 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Pushing event updated for resources: {'Subnet': ['ID=119e0a0a-4f75-4580-afee-ce96f3e12878,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:42.100977 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:42.105307 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Checking segment: {'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:18:42.105836 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Network hostable DHCP agents. Network: ff8e44fb-6ead-46de-8521-764b50418880, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92421) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:18:42.281777 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Network ff8e44fb-6ead-46de-8521-764b50418880 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92421) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:18:42.393724 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685ee35b-5082-4e73-8f5e-b90f114f9ae5 req-78ef5bf7-f536-4203-8188-10fab06592c8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:42.395400 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-685ee35b-5082-4e73-8f5e-b90f114f9ae5 req-78ef5bf7-f536-4203-8188-10fab06592c8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1534393
May 20 16:18:42.404314 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8643b787-80b5-4139-8008-314b6bac181b req-d8203c75-aa48-40bc-a5f7-7333a96c1d3c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:42.405561 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5948d4d9-4307-4294-a458-260cc0b0d3d4 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:18:42.406038 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8643b787-80b5-4139-8008-314b6bac181b req-d8203c75-aa48-40bc-a5f7-7333a96c1d3c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 944 time: 0.1303258
May 20 16:18:42.443571 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59876) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:42.467829 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, ff8e44fb-6ead-46de-8521-764b50418880) {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:18:42.479340 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-605d20db-1778-4007-81cf-6f040e1033ab None None] Network ff8e44fb-6ead-46de-8521-764b50418880 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:18:42.496641 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-685ee35b-5082-4e73-8f5e-b90f114f9ae5 req-36809658-3d8a-4ecd-af90-02dd05a5bb52 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0851426
May 20 16:18:42.505890 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8643b787-80b5-4139-8008-314b6bac181b req-7c728d7e-11c1-4401-89b0-ebfbe6329e37 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782788
May 20 16:18:42.523818 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:42.524439 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:42.682523 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-cef76e9e-96e5-416c-9d7e-9c1878c10038 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.4006863
May 20 16:18:42.735328 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc8f0e65-f6de-49c1-aab6-a7b93e91b46c None None] Network ff8e44fb-6ead-46de-8521-764b50418880 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:18:42.754824 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 5948d4d9-4307-4294-a458-260cc0b0d3d4 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:18:42.771267 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 5948d4d9-4307-4294-a458-260cc0b0d3d4 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:18:42.771769 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:42.868226 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:42.878716 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59888) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:42.908502 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:42.916132 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Usage tracker for resource:security_group_rule and tenant:8de63c1c5e5343eebc6d70e1f66ac4ff is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:42.922184 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:42.932735 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:43.040819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.047765 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.071421 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:43.078398 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Usage tracker for resource:security_group_rule and tenant:8843b94e299d4bfd82b4c4c78e7819a4 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:43.083215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:43.094082 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:43.107750 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.115356 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40273433-6605-47d8-b622-2f20548a035e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5948d4d9-4307-4294-a458-260cc0b0d3d4'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:18:43.131472 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 5948d4d9-4307-4294-a458-260cc0b0d3d4, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5948d4d9-4307-4294-a458-260cc0b0d3d4,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:43.162433 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3a72b8-e8ca-48d2-8ecc-bd2bf1aa444c req-200fa4bd-fabf-4098-8e48-8d463cd039a7 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:43.164775 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7c3a72b8-e8ca-48d2-8ecc-bd2bf1aa444c req-200fa4bd-fabf-4098-8e48-8d463cd039a7 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 943 time: 0.2463388
May 20 16:18:43.171459 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40273433-6605-47d8-b622-2f20548a035e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5948d4d9-4307-4294-a458-260cc0b0d3d4', 'code': 200}
May 20 16:18:43.213360 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7c3a72b8-e8ca-48d2-8ecc-bd2bf1aa444c req-5ce27c73-6de6-407d-b282-fa6705f737bb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419161
May 20 16:18:43.278400 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.285016 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.285626 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:43.300660 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:43.380483 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad94468a-40cb-4a50-ab99-9995b333bc2e,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:43.397158 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=8de63c1c5e5343eebc6d70e1f66ac4ff&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9495776
May 20 16:18:43.397328 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.397781 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:43.397887 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59902) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:43.417206 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=5948d4d9-4307-4294-a458-260cc0b0d3d4,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:43.421124 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:43.470218 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.473160 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.494490 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ea35ecb6-e75c-44f7-a378-cd4ae05db9a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:43.557264 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.584363 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a0f435c-224c-4790-88f0-a3f96af4976b,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:43.593986 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=8843b94e299d4bfd82b4c4c78e7819a4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7137063
May 20 16:18:43.594819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:43.603820 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59914) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:43.711571 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.743817 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-853b0872-aa28-4002-a979-3f80e829dfa7 req-68c97c7d-91ad-4f42-b344-0f61f61d4658 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:43.745783 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-853b0872-aa28-4002-a979-3f80e829dfa7 req-68c97c7d-91ad-4f42-b344-0f61f61d4658 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 1098 time: 0.1617820
May 20 16:18:43.812301 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-853b0872-aa28-4002-a979-3f80e829dfa7 req-87839672-f7ac-4864-ba0b-765655bc24f2 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0581243
May 20 16:18:43.888301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.900469 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a55789eb-d076-4b9c-a5f2-f4c4b6a7acc8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:43.924136 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.937584 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad94468a-40cb-4a50-ab99-9995b333bc2e,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:43.950588 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:43.988891 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:43.989997 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/ad94468a-40cb-4a50-ab99-9995b333bc2e HTTP/1.1" status: 204  len: 168 time: 0.5916693
May 20 16:18:44.018388 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357db04e-962d-4bc9-85a1-5314d51823ed req-62a8d0ef-cef2-448d-a102-e62858855f61 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:44.019872 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-357db04e-962d-4bc9-85a1-5314d51823ed req-62a8d0ef-cef2-448d-a102-e62858855f61 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.3097532
May 20 16:18:44.032133 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e9c1dc4-21c6-40f1-8823-ae63372e6ec4 req-20fac644-e5af-4e85-acac-3934517f1092 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:44.033605 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7e9c1dc4-21c6-40f1-8823-ae63372e6ec4 req-20fac644-e5af-4e85-acac-3934517f1092 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.2716596
May 20 16:18:44.106688 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-357db04e-962d-4bc9-85a1-5314d51823ed req-5b5bb31e-8f76-4994-be47-1b55852a6651 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0709486
May 20 16:18:44.109454 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7e9c1dc4-21c6-40f1-8823-ae63372e6ec4 req-2e28f76c-c52e-429f-b628-048206a65a4c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0602577
May 20 16:18:44.190260 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:44.195810 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-9a9358fd-d801-40f9-b37d-74f2ee64f52c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:44.206752 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a0f435c-224c-4790-88f0-a3f96af4976b,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:44.210598 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:44.213958 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:44.218223 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/8a0f435c-224c-4790-88f0-a3f96af4976b HTTP/1.1" status: 204  len: 168 time: 0.6097679
May 20 16:18:44.412771 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 82c98f0c-1ea5-462d-9be5-cd913e8b063c details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:18:44.422587 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce21d17-985e-4eba-8175-b11becbb17ed req-89698a7f-8e58-4f27-b299-e58dce268e22 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:44.424178 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ce21d17-985e-4eba-8175-b11becbb17ed req-89698a7f-8e58-4f27-b299-e58dce268e22 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 943 time: 0.0869918
May 20 16:18:44.473766 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ce21d17-985e-4eba-8175-b11becbb17ed req-b64568a5-7def-4468-9e3e-e61d21f4362c tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437112
May 20 16:18:44.556857 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 82c98f0c-1ea5-462d-9be5-cd913e8b063c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=82c98f0c-1ea5-462d-9be5-cd913e8b063c,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:44.571497 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '82c98f0c-1ea5-462d-9be5-cd913e8b063c', 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca', 'port_id': '82c98f0c-1ea5-462d-9be5-cd913e8b063c', 'mac_address': 'fa:16:3e:0d:9f:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 639, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a138ecac-0095-4014-bd32-91dbb855f1d1', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:18:44.630771 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:44.651241 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 82c98f0c-1ea5-462d-9be5-cd913e8b063c {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:18:44.668285 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 82c98f0c-1ea5-462d-9be5-cd913e8b063c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=82c98f0c-1ea5-462d-9be5-cd913e8b063c,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:44.785858 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:44.788057 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:44.863663 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=82c98f0c-1ea5-462d-9be5-cd913e8b063c,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:44.867149 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:45.333397 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['82c98f0c-1ea5-462d-9be5-cd913e8b063c'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:18:45.411479 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6bae85-7a0d-4ae4-921d-e2fdc4ef9677 req-76e47aab-63c3-4f44-b4df-eeea390e6b8f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:45.412374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 59964) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:45.418612 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5b6bae85-7a0d-4ae4-921d-e2fdc4ef9677 req-76e47aab-63c3-4f44-b4df-eeea390e6b8f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.1789103
May 20 16:18:45.436519 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:45.459204 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:45.466288 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Usage tracker for resource:security_group_rule and tenant:86eba86777314065be4ecf939c8b74cc is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:45.470585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:45.473223 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7220615b-71c8-4574-9783-a2ec345009b3 req-94465a45-fd79-4487-955e-06e8a332231f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:45.478216 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:45.480798 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7220615b-71c8-4574-9783-a2ec345009b3 req-94465a45-fd79-4487-955e-06e8a332231f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.2396586
May 20 16:18:45.518258 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5b6bae85-7a0d-4ae4-921d-e2fdc4ef9677 req-adade431-e855-4118-9b78-78b7389a556b tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0986471
May 20 16:18:45.595052 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7220615b-71c8-4574-9783-a2ec345009b3 req-23a36f84-c51d-4424-b0d5-cc5702033341 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1135869
May 20 16:18:45.686020 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:45.766136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:45.780209 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-371ea878-8cde-49d0-80c4-8ab6703137b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:45.843544 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=86eba86777314065be4ecf939c8b74cc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4293258
May 20 16:18:45.844452 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf1167ec-6081-474d-8a14-a1790100edb1,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:45.853118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 59980) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:45.862658 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:45.895753 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79a0068-6207-4e42-885b-49920c8acea4 req-f5bd5919-1f62-402c-89be-a9f8745cbabe tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:45.897300 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c79a0068-6207-4e42-885b-49920c8acea4 req-f5bd5919-1f62-402c-89be-a9f8745cbabe tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 944 time: 0.1245847
May 20 16:18:45.928228 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-91f063e7-51d7-4faf-a708-76d16e0c3960 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:45.962963 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:18:45.972851 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c79a0068-6207-4e42-885b-49920c8acea4 req-0421a624-46ea-470e-8714-8b7461d968f7 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0654130
May 20 16:18:45.973498 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-52a32313-9408-46a3-b7d8-4b28f4349fab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:46.002349 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-52a32313-9408-46a3-b7d8-4b28f4349fab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:46.194686 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-52a32313-9408-46a3-b7d8-4b28f4349fab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:46.198503 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a4ba76a1-fd5c-4fc4-91e0-6e3c3d84b29f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:46.210537 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a32313-9408-46a3-b7d8-4b28f4349fab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf1167ec-6081-474d-8a14-a1790100edb1,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:46.213612 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-52a32313-9408-46a3-b7d8-4b28f4349fab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:46.221120 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-52a32313-9408-46a3-b7d8-4b28f4349fab admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:46.224265 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-52a32313-9408-46a3-b7d8-4b28f4349fab admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/cf1167ec-6081-474d-8a14-a1790100edb1 HTTP/1.1" status: 204  len: 168 time: 0.3692353
May 20 16:18:46.750670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0bfc11-a606-4a47-874b-c84162ef4b0c req-f50b4eb4-73ea-4122-963a-a82952bff3dd tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:46.779875 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ec0bfc11-a606-4a47-874b-c84162ef4b0c req-f50b4eb4-73ea-4122-963a-a82952bff3dd tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.1458664
May 20 16:18:46.857809 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ec0bfc11-a606-4a47-874b-c84162ef4b0c req-cf24e8c7-cc63-40a2-9a92-c3d74577d4dd tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0765233
May 20 16:18:47.189449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94cfb0a1-dc99-4428-b036-a211dfc88a03 req-3553d238-51f3-4b7d-b4cc-a29510162fad tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:47.192125 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-94cfb0a1-dc99-4428-b036-a211dfc88a03 req-3553d238-51f3-4b7d-b4cc-a29510162fad tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 944 time: 0.0985858
May 20 16:18:47.293943 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-94cfb0a1-dc99-4428-b036-a211dfc88a03 req-1a7ed303-c517-42cc-84de-53a65e9266d0 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0928829
May 20 16:18:47.512044 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-787f00cf-f118-4fb5-a7f2-11ec755be548 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:47.514122 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-787f00cf-f118-4fb5-a7f2-11ec755be548 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/networks?id=ff8e44fb-6ead-46de-8521-764b50418880 HTTP/1.1" status: 200  len: 808 time: 0.1632750
May 20 16:18:47.528564 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-3562ae3d-a2a7-464d-953d-d998b9e34855 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/quotas/bfea173096cf4b509735ffd535193ea5 HTTP/1.1" status: 200  len: 375 time: 0.0089383
May 20 16:18:47.574638 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-b90950ef-bc07-4bd9-9101-382202b490b3 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=bfea173096cf4b509735ffd535193ea5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0407779
May 20 16:18:47.708975 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-32cef970-a413-47a6-ace5-13d32a113ab3 service neutron] 10.222.0.64 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1269965
May 20 16:18:47.849644 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-30cb08c3-a82e-4af6-9a11-fd80ed0d47c2 service neutron] 10.222.0.64 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1347406
May 20 16:18:48.098375 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-94ee3b78-07c4-4c91-a5e1-98b2c66a98b3 req-0ba5ce47-1b02-44f6-ba2f-3b9f1dffd2c7 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 210 time: 0.0423737
May 20 16:18:48.425227 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:48.447476 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 82c98f0c-1ea5-462d-9be5-cd913e8b063c up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:18:48.516275 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecf0b70-7795-4875-aa5c-f168fc425ee5 req-63382951-5441-4ee6-9afc-2a606a5b1ba0 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:48.517771 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4ecf0b70-7795-4875-aa5c-f168fc425ee5 req-63382951-5441-4ee6-9afc-2a606a5b1ba0 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 944 time: 0.1065505
May 20 16:18:48.565610 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4ecf0b70-7795-4875-aa5c-f168fc425ee5 req-f2a4f482-5971-4797-b1e0-2e2118b98dc1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416646
May 20 16:18:48.722405 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 82c98f0c-1ea5-462d-9be5-cd913e8b063c completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:18:48.727486 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 82c98f0c-1ea5-462d-9be5-cd913e8b063c triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:18:48.727859 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:48.794575 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c52af84f-b182-49ad-a9cc-79c2589bcbec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:48.851734 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:48.880952 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82c98f0c-1ea5-462d-9be5-cd913e8b063c'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:18:48.891955 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 82c98f0c-1ea5-462d-9be5-cd913e8b063c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=82c98f0c-1ea5-462d-9be5-cd913e8b063c,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:18:48.937215 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82c98f0c-1ea5-462d-9be5-cd913e8b063c', 'code': 200}
May 20 16:18:49.059008 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:49.061454 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:49.091518 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfeadf13-99ba-4a44-9576-94e9181040df req-72734474-80b3-4a0d-a9f9-4f3f82bdcbf9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:49.092978 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cfeadf13-99ba-4a44-9576-94e9181040df req-72734474-80b3-4a0d-a9f9-4f3f82bdcbf9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0783854
May 20 16:18:49.133384 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=82c98f0c-1ea5-462d-9be5-cd913e8b063c,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:49.136759 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:49.142548 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cfeadf13-99ba-4a44-9576-94e9181040df req-140c408d-2708-4249-ac04-fb737b13746f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432701
May 20 16:18:49.314736 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-be5958a9-ffff-4356-9fb0-23cd9f847150 req-ec1c594a-0764-44db-ae65-f762c6f4945c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 210 time: 0.1217785
May 20 16:18:49.592149 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21671981-8c35-449f-b44c-30c1f68b81ee req-e8585a64-828a-4704-92d6-2741bce87296 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:49.593626 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-21671981-8c35-449f-b44c-30c1f68b81ee req-e8585a64-828a-4704-92d6-2741bce87296 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 1098 time: 0.0754356
May 20 16:18:49.635735 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-21671981-8c35-449f-b44c-30c1f68b81ee req-8cea6021-92b8-4299-a907-d0539aaa1ab6 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0353417
May 20 16:18:49.671167 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:49.756605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2348bd62-9f43-4d73-85af-2e4f6004e34e req-6735ec8f-4aa5-49eb-9442-7c471e913fb0 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:49.758088 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2348bd62-9f43-4d73-85af-2e4f6004e34e req-6735ec8f-4aa5-49eb-9442-7c471e913fb0 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 945 time: 0.0830216
May 20 16:18:49.813789 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2348bd62-9f43-4d73-85af-2e4f6004e34e req-ed028cb1-9c85-4919-b05e-52fdaec53723 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496943
May 20 16:18:50.955622 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba8bbc67-bee0-4000-bfa3-ea2275a159e2 req-c3f7f3fa-4224-4909-a35e-4e09d9157e3f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 210 time: 0.0430913
May 20 16:18:51.168001 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa991df-3622-4735-9cbc-bcbd8e383a4f req-f219f145-c88d-4b79-a3bb-2e6592fa9fbb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:51.177420 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1fa991df-3622-4735-9cbc-bcbd8e383a4f req-f219f145-c88d-4b79-a3bb-2e6592fa9fbb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 945 time: 0.1185594
May 20 16:18:51.229029 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1fa991df-3622-4735-9cbc-bcbd8e383a4f req-2527022e-1591-4eda-b907-81b13a56cb75 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0498805
May 20 16:18:51.288897 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:51.603767 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-078b4a12-7ec7-4611-b0d4-3218c5229e78 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:51.606554 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-078b4a12-7ec7-4611-b0d4-3218c5229e78 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Synchronizing usage tracker for tenant:bfea173096cf4b509735ffd535193ea5 on resource:network {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:18:51.699225 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-078b4a12-7ec7-4611-b0d4-3218c5229e78 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Unset dirty status for tenant:bfea173096cf4b509735ffd535193ea5 on resource:network {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:18:51.700966 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-078b4a12-7ec7-4611-b0d4-3218c5229e78 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "GET /v2.0/networks?id=ff8e44fb-6ead-46de-8521-764b50418880 HTTP/1.1" status: 200  len: 808 time: 0.2525024
May 20 16:18:51.713831 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Request body: {'port': {'device_id': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880', 'admin_state_up': True, 'tenant_id': 'bfea173096cf4b509735ffd535193ea5'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:51.929214 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:51.933538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Usage tracker for resource:port and tenant:bfea173096cf4b509735ffd535193ea5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:51.936854 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:51.942607 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:52.113717 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f8b81c8f-60ee-4835-8831-886f4b292849 req-28e972eb-31c0-462a-9b2e-cc7888fab734 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 210 time: 0.0432019
May 20 16:18:52.145174 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Made reservation on behalf of bfea173096cf4b509735ffd535193ea5 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:52.148668 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.237655 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 60148) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:52.319929 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Allocated IP 172.20.0.14 (ff8e44fb-6ead-46de-8521-764b50418880/119e0a0a-4f75-4580-afee-ce96f3e12878/d7e1b8b3-8705-4d1e-989b-6de8cd48c38e) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:18:52.404757 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.431283 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:52.438390 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Usage tracker for resource:security_group_rule and tenant:749cdb192a5f4b519fa0e25dfad79a25 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:52.442202 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:52.449500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:52.484933 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0193a89-106a-4d16-a268-0a365258a7f4 req-2bbfcc4a-60d0-4f7d-8ea3-1aa7e68cc66b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:52.486332 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c0193a89-106a-4d16-a268-0a365258a7f4 req-2bbfcc4a-60d0-4f7d-8ea3-1aa7e68cc66b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 945 time: 0.1423793
May 20 16:18:52.521955 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.549774 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c0193a89-106a-4d16-a268-0a365258a7f4 req-65ec4381-fd03-4928-a23c-eb140155fd87 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0565586
May 20 16:18:52.595282 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.634895 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.650739 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd0fc31e-d55a-4574-b476-b5e0557f5b09 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:52.699499 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.708655 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-40680477-aa49-4816-bf36-342c46505d8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:52.710069 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Network ff8e44fb-6ead-46de-8521-764b50418880 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:18:52.713311 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:18:52.717484 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:18:52.755412 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Pushing event updated for resources: {'Port': ['ID=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:52.760180 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=749cdb192a5f4b519fa0e25dfad79a25&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5213211
May 20 16:18:52.764021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 60190) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:52.766264 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33ddf902-fb9b-4e8d-b106-e3e529408b6b,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:52.770011 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:52.779790 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:52.807368 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:52.808003 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.827729 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.858332 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.955623 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.2457101
May 20 16:18:52.977864 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:52.983300 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-0c735978-70b8-493a-a539-1f63e2b68022 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:52.994965 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33ddf902-fb9b-4e8d-b106-e3e529408b6b,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:52.998359 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:53.004051 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:53.006542 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/33ddf902-fb9b-4e8d-b106-e3e529408b6b HTTP/1.1" status: 204  len: 168 time: 0.2408235
May 20 16:18:53.309331 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cc6b4f7-4004-42d2-844c-c2622e0d2a50 req-1e55eb85-b7c0-4b5c-94a5-5e4c5af90e7f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:53.311736 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8cc6b4f7-4004-42d2-844c-c2622e0d2a50 req-1e55eb85-b7c0-4b5c-94a5-5e4c5af90e7f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 932 time: 0.0848796
May 20 16:18:53.358582 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8cc6b4f7-4004-42d2-844c-c2622e0d2a50 req-9ca96459-de48-464a-871a-fa5d7a7dbf55 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388699
May 20 16:18:53.838354 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 60220) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:53.856058 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:53.873307 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:53.877086 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Usage tracker for resource:security_group_rule and tenant:f4c3b098361745a39cd36f475da7b301 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:53.879863 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:53.885578 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:53.964432 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:54.036079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:54.043256 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-0bcf7706-dabc-4a60-a4a8-56536b861321 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:54.085147 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=f4c3b098361745a39cd36f475da7b301&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2457490
May 20 16:18:54.086159 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1592e269-0279-4743-93be-a2dddf0290ca,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:54.087853 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 60224) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:54.089129 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:54.148601 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:54.173880 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:54.293088 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:54.296895 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-35b61940-53f8-4237-be76-cee510dcbbe9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:54.307694 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1592e269-0279-4743-93be-a2dddf0290ca,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:54.310432 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:54.316416 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:54.317535 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/1592e269-0279-4743-93be-a2dddf0290ca HTTP/1.1" status: 204  len: 168 time: 0.2287076
May 20 16:18:54.549035 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b84fea1e-837c-447f-98ec-88f359241d5a req-d20f57ea-cd49-4482-89d9-8b28a7bf9892 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:54.550718 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b84fea1e-837c-447f-98ec-88f359241d5a req-d20f57ea-cd49-4482-89d9-8b28a7bf9892 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 932 time: 0.0813498
May 20 16:18:54.610405 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b84fea1e-837c-447f-98ec-88f359241d5a req-76d90293-0841-4f4e-93de-a694b2b5a57d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0486166
May 20 16:18:55.060632 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 60242) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:55.078653 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:55.093732 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:55.097646 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Usage tracker for resource:security_group_rule and tenant:ae52c76bd9ce4ba9a460b40eedd7e235 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:55.100416 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:55.106360 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:55.188872 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:55.282192 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:55.289506 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:55.330412 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ae52c76bd9ce4ba9a460b40eedd7e235&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2686777
May 20 16:18:55.331316 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9381a1fb-d882-4b00-ac28-1985256a0a4a,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:55.333174 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 60246) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:55.334442 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:55.390755 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:55.416382 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:55.533394 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:55.537460 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-389d659d-68ce-441e-8ec8-198876182079 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:55.549276 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9381a1fb-d882-4b00-ac28-1985256a0a4a,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:55.551844 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:55.559658 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:55.560758 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/9381a1fb-d882-4b00-ac28-1985256a0a4a HTTP/1.1" status: 204  len: 168 time: 0.2265797
May 20 16:18:55.807104 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37c8b8e-bf6d-4487-9e4c-5da3817a779a req-db3fb6ba-8d2a-4deb-a845-008fdeca94cf tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:55.808585 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f37c8b8e-bf6d-4487-9e4c-5da3817a779a req-db3fb6ba-8d2a-4deb-a845-008fdeca94cf tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 932 time: 0.0911498
May 20 16:18:55.863653 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f37c8b8e-bf6d-4487-9e4c-5da3817a779a req-05aaf2f4-98b4-4ee2-86ee-429d8dbd5c29 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484159
May 20 16:18:56.194759 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Request body: {'port': {'device_id': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:56.373021 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:56.417638 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-10030322-e030-41e8-9285-769e5b249fb8 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1596630
May 20 16:18:56.719740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-80f54f0f-17c4-426b-b7dc-c958c9c88e29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:56.721213 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-80f54f0f-17c4-426b-b7dc-c958c9c88e29 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.1601703
May 20 16:18:56.873642 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7e1b8b3-8705-4d1e-989b-6de8cd48c38e {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:18:56.894927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:56.915627 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 60304) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:56.920728 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Transition to ACTIVE for port object d7e1b8b3-8705-4d1e-989b-6de8cd48c38e will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:18:56.937602 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-9cb6e0de-5591-45d1-a62a-a7ad15195354 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:56.939062 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-9cb6e0de-5591-45d1-a62a-a7ad15195354 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.1740129
May 20 16:18:57.034148 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-384a7653-c3f3-4698-b649-bb8dc36a4e65 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 217 time: 0.0882993
May 20 16:18:57.078285 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1573331969-network', 'tenant_id': '2d0eeaab3cf644b5833061be9449e13d'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:57.085295 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:57.092262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Usage tracker for resource:network and tenant:2d0eeaab3cf644b5833061be9449e13d is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:57.096201 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:57.106851 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-eea4d335-a53a-494e-868c-493427a9c45b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:57.106989 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:57.107067 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-eea4d335-a53a-494e-868c-493427a9c45b service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0645971
May 20 16:18:57.114423 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ac1e2e-330c-485b-8de0-3d90771b7e39 req-1bc5c1f2-090d-43ae-b752-e9134cb614b1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:57.115031 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.116361 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-55ac1e2e-330c-485b-8de0-3d90771b7e39 req-1bc5c1f2-090d-43ae-b752-e9134cb614b1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 932 time: 0.1097410
May 20 16:18:57.128585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:57.169275 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-55ac1e2e-330c-485b-8de0-3d90771b7e39 req-16661dce-479f-4b5c-a7b0-2bf834ab4569 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0452268
May 20 16:18:57.231420 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Made reservation on behalf of 2d0eeaab3cf644b5833061be9449e13d for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:57.233849 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.247305 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.266858 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:57.271125 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Usage tracker for resource:security_group_rule and tenant:2d0eeaab3cf644b5833061be9449e13d is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:57.274902 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:57.283153 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:57.394408 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-8bbc1ebc-f975-44e2-9254-2e6de44fad95 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2669134
May 20 16:18:57.400587 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.482235 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Pushing event updated for resources: {'Port': ['ID=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:57.482535 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.487294 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-89d55bfb-6e46-48ba-8d78-fe7d9c9586e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:57.504556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.376s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:57.513691 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] vlan segment allocate from pool success with {'vlan_id': 613, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:18:57.527374 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57077c75-bfd7-4b14-9636-3e7d8932f3e6,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:57.534370 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:57.541578 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.541881 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Added segment 1bdeb0b5-b2b5-415a-827c-6b7f1e164ede of type vlan for network 853a1012-183a-434d-8802-c341517512ed
May 20 16:18:57.575270 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.628768 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Attempting to bind port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:18:57.629104 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Attempting to bind port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:18:57.629552 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Attempting to bind port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e on network ff8e44fb-6ead-46de-8521-764b50418880 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:18:57.644549 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e on network ff8e44fb-6ead-46de-8521-764b50418880 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:18:57.644874 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Attempting to bind port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e on network ff8e44fb-6ead-46de-8521-764b50418880 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:18:57.655419 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 18, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:18:57.655753 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Checking segment: {'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:18:57.656131 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Bound using segment: {'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:18:57.656586 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Bound port: d7e1b8b3-8705-4d1e-989b-6de8cd48c38e, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:18:57.656934 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.666919 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-e59445e4-d2bf-4f06-9375-5c79c2262bd8 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1863728
May 20 16:18:57.710465 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.711951 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:57.712531 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.718521 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-46b53d9b-60ae-4ded-b509-80586323d832 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:57.836354 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Pushing event updated for resources: {'Network': ['ID=853a1012-183a-434d-8802-c341517512ed,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:57.843402 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.9265850
May 20 16:18:57.843690 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 60328) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:18:57.844951 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:57.849647 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 853a1012-183a-434d-8802-c341517512ed details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:18:57.852374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] For port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:18:57.858347 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Request body: {'subnet': {'network_id': '853a1012-183a-434d-8802-c341517512ed', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1573331969-subnet', 'tenant_id': '2d0eeaab3cf644b5833061be9449e13d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:18:57.870857 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:18:57.873873 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] For port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:18:57.885163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Usage tracker for resource:subnet and tenant:2d0eeaab3cf644b5833061be9449e13d is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:18:57.908061 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:18:57.916556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:18:57.920696 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31406922-7cd9-4100-bf6c-ce231c46e453 req-23e3914f-d0c3-4b0b-b0da-a62b67fc5557 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2200024
May 20 16:18:57.962562 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:57.969261 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:58.030405 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:58.031018 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:58.032402 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] 10.222.0.16 "PUT /v2.0/ports/d7e1b8b3-8705-4d1e-989b-6de8cd48c38e HTTP/1.1" status: 200  len: 1094 time: 1.8424239
May 20 16:18:58.032889 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'tag': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:18:58.055140 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Pushing event updated for resources: {'Port': ['ID=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:58.059276 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Made reservation on behalf of 2d0eeaab3cf644b5833061be9449e13d for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:18:58.061822 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6223402'] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:58.076189 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:58.083914 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'tag': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e', 'status': 'completed', 'code': 200}
May 20 16:18:58.290681 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ec2ea7-7788-4892-9006-d4ccc45038fc req-7bb7bc5e-913b-43dc-8f9b-e7dc01dbc392 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:58.292195 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-55ec2ea7-7788-4892-9006-d4ccc45038fc req-7bb7bc5e-913b-43dc-8f9b-e7dc01dbc392 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=bfea173096cf4b509735ffd535193ea5&device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 1097 time: 0.1439548
May 20 16:18:58.395081 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301b4872-2ae7-4b86-8b95-b1f402a03bb7 req-425fc3c6-0537-4a16-a3a2-43561713e828 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:58.396806 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301b4872-2ae7-4b86-8b95-b1f402a03bb7 req-425fc3c6-0537-4a16-a3a2-43561713e828 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0953069
May 20 16:18:58.467748 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301b4872-2ae7-4b86-8b95-b1f402a03bb7 req-1e0e012f-862b-475d-8ecc-be4dab28a91f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0606472
May 20 16:18:58.515781 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ec2ea7-7788-4892-9006-d4ccc45038fc req-cb63383c-2cd9-47f3-9045-4da06c56d5ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:58.517233 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-55ec2ea7-7788-4892-9006-d4ccc45038fc req-cb63383c-2cd9-47f3-9045-4da06c56d5ca service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=bfea173096cf4b509735ffd535193ea5&shared=False HTTP/1.1" status: 200  len: 909 time: 0.2166653
May 20 16:18:58.653714 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:58.691962 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ec2ea7-7788-4892-9006-d4ccc45038fc req-6727914b-b23e-41a9-8d4c-e0c759c872be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:58.693386 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-55ec2ea7-7788-4892-9006-d4ccc45038fc req-6727914b-b23e-41a9-8d4c-e0c759c872be service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1697476
May 20 16:18:58.850695 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c9114723-1cfa-4a90-be8e-9b3c0d18dc51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:58.852149 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-c9114723-1cfa-4a90-be8e-9b3c0d18dc51 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=bfea173096cf4b509735ffd535193ea5&device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 1097 time: 0.0877905
May 20 16:18:59.028901 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-4023fae8-5dfc-49db-9c67-b5826dafc9e2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e HTTP/1.1" status: 200  len: 217 time: 0.1496038
May 20 16:18:59.087356 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6358878', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6223416'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:59.098700 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-51d65bab-f54a-4659-8a7f-c10e7429d4a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:18:59.164190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-8b4b577c-dbe9-495e-b29f-2d79d194bb24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:59.165619 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-8b4b577c-dbe9-495e-b29f-2d79d194bb24 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=119e0a0a-4f75-4580-afee-ce96f3e12878 HTTP/1.1" status: 200  len: 848 time: 0.1203864
May 20 16:18:59.231349 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1d53e6da-5a0a-4b0a-95e9-3ce09d811a16,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:18:59.235449 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:18:59.237991 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-42181bf9-afc9-431c-96fc-d54dbd6c2e1f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=ff8e44fb-6ead-46de-8521-764b50418880&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0613329
May 20 16:18:59.241992 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Checking segment: {'id': '1bdeb0b5-b2b5-415a-827c-6b7f1e164ede', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '853a1012-183a-434d-8802-c341517512ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:18:59.242336 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Network hostable DHCP agents. Network: 853a1012-183a-434d-8802-c341517512ed, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:18:59.361645 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Network 853a1012-183a-434d-8802-c341517512ed is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:18:59.389068 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-a5607c28-9168-4146-976c-ac14e56e667a service neutron] 10.222.0.16 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1382811
May 20 16:18:59.440209 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 853a1012-183a-434d-8802-c341517512ed) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:18:59.448892 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-592f7b81-4a9d-44ba-a337-03ef575abbfd None None] Network 853a1012-183a-434d-8802-c341517512ed requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:18:59.449371 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:59.449610 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:18:59.544416 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.6982961
May 20 16:18:59.653749 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-955bbf31-969e-476c-a26f-fe54c21fd550 None None] Network 853a1012-183a-434d-8802-c341517512ed requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:18:59.705215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2e6138-a352-494c-aa04-58b64708bb8c req-161e3e0b-5158-4ff0-b173-d85cf1b079b9 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:18:59.712945 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5b2e6138-a352-494c-aa04-58b64708bb8c req-161e3e0b-5158-4ff0-b173-d85cf1b079b9 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.1205249
May 20 16:18:59.759786 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5b2e6138-a352-494c-aa04-58b64708bb8c req-22d08ad2-dedc-41e2-9482-ee99dfd52482 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458908
May 20 16:19:00.405963 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 60378) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:00.411525 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-544652505-network', 'tenant_id': '2f5e810c0dc440c1b9de41e30dd0d19a'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:19:00.416174 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:00.421441 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Usage tracker for resource:network and tenant:2f5e810c0dc440c1b9de41e30dd0d19a is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:00.424307 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:00.429916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:00.548555 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Made reservation on behalf of 2f5e810c0dc440c1b9de41e30dd0d19a for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:19:00.550909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.563481 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.578147 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:00.582013 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Usage tracker for resource:security_group_rule and tenant:2f5e810c0dc440c1b9de41e30dd0d19a is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:00.584909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:00.591588 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:00.673634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.782743 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.785806 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-fbb14385-7381-4712-9fda-d3b7dae8913b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:00.816763 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] vlan segment allocate from pool success with {'vlan_id': 621, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:19:00.822013 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff4b7e86-e0bb-4062-9c07-9432b173175f,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:00.825864 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:00.831955 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.832396 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Added segment a10babc1-2d23-4bf5-83a6-09aee2cd359a of type vlan for network c878f4fe-30d7-4d89-879e-939fcf7b6554
May 20 16:19:00.862928 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.984533 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.985901 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:00.986496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:00.991685 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2f32780d-b908-4225-91c3-8e2159250659 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:01.006571 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c0ede1-b1e7-4c05-8fac-37f75af35c92 req-ac839ea0-be56-430b-8704-7344ada0090d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:01.008078 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19c0ede1-b1e7-4c05-8fac-37f75af35c92 req-ac839ea0-be56-430b-8704-7344ada0090d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.1350329
May 20 16:19:01.052384 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19c0ede1-b1e7-4c05-8fac-37f75af35c92 req-b1ebc165-fca3-40d0-951d-d96dd799c788 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376163
May 20 16:19:01.085960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Pushing event updated for resources: {'Network': ['ID=c878f4fe-30d7-4d89-879e-939fcf7b6554,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:01.088624 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:01.096173 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network c878f4fe-30d7-4d89-879e-939fcf7b6554 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:19:01.229854 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.8225775
May 20 16:19:01.233369 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 60388) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:01.239314 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Request body: {'subnet': {'network_id': 'c878f4fe-30d7-4d89-879e-939fcf7b6554', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-544652505-subnet', 'tenant_id': '2f5e810c0dc440c1b9de41e30dd0d19a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:19:01.244574 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:01.249151 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Usage tracker for resource:subnet and tenant:2f5e810c0dc440c1b9de41e30dd0d19a is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:01.252293 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:01.259259 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:01.333514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Made reservation on behalf of 2f5e810c0dc440c1b9de41e30dd0d19a for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:19:01.335937 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6223402'] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:01.782747 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6358878', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6223416'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:01.787155 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:01.859840 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Pushing event updated for resources: {'Subnet': ['ID=e1e82f44-8ecf-40bd-915b-dbec42cc9de9,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:01.863251 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:01.869037 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Checking segment: {'id': 'a10babc1-2d23-4bf5-83a6-09aee2cd359a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'c878f4fe-30d7-4d89-879e-939fcf7b6554'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:19:01.869385 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Network hostable DHCP agents. Network: c878f4fe-30d7-4d89-879e-939fcf7b6554, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:19:01.950475 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Network c878f4fe-30d7-4d89-879e-939fcf7b6554 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:19:02.018904 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, c878f4fe-30d7-4d89-879e-939fcf7b6554) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:19:02.027532 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1758e7e-2fad-486d-ad7f-4ddc3e59c185 None None] Network c878f4fe-30d7-4d89-879e-939fcf7b6554 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:19:02.027804 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:02.028393 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:02.120872 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.8860199
May 20 16:19:02.234138 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7b94fa4-ed15-4277-b123-1217aefc8f1f None None] Network c878f4fe-30d7-4d89-879e-939fcf7b6554 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:19:02.266896 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9ba5cb-cd52-45ec-af10-8dcdca6e3e0d req-f973bcc3-8377-45bd-83dd-3538df81715f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:02.269022 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dd9ba5cb-cd52-45ec-af10-8dcdca6e3e0d req-f973bcc3-8377-45bd-83dd-3538df81715f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.1047578
May 20 16:19:02.342529 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dd9ba5cb-cd52-45ec-af10-8dcdca6e3e0d req-3574b616-ff9e-4097-8351-35508b44cf27 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0675740
May 20 16:19:03.535264 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e859dddf-2fec-4f74-9710-bf3a2fbb0961 req-1e911584-7285-4c60-bfe5-3f5bfcf65d22 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:03.536747 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e859dddf-2fec-4f74-9710-bf3a2fbb0961 req-1e911584-7285-4c60-bfe5-3f5bfcf65d22 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0819256
May 20 16:19:03.585861 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e859dddf-2fec-4f74-9710-bf3a2fbb0961 req-0d331b58-5582-42cb-b368-432fccb3e79b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432799
May 20 16:19:04.787242 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c36e4bd-1ee4-48dd-a747-74c03bb574f7 req-1e261325-cdbf-4dbf-a3d6-67d5b04125e8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:04.788715 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7c36e4bd-1ee4-48dd-a747-74c03bb574f7 req-1e261325-cdbf-4dbf-a3d6-67d5b04125e8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0874441
May 20 16:19:04.834731 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7c36e4bd-1ee4-48dd-a747-74c03bb574f7 req-3c23e49b-44e6-43b5-a453-f4fd8ce8689b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395296
May 20 16:19:05.251678 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-864bdd45-e826-4cdd-92c4-0d31ba337f31 req-80f32771-9480-40cc-a297-13471dfc6d95 service neutron] 10.222.0.16 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1286330
May 20 16:19:06.024081 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6411dec-1443-4abf-a836-2f829f67157a req-8681ec7f-32d4-4e34-a205-e86a2f92e684 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:06.025722 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d6411dec-1443-4abf-a836-2f829f67157a req-8681ec7f-32d4-4e34-a205-e86a2f92e684 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0835104
May 20 16:19:06.071761 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d6411dec-1443-4abf-a836-2f829f67157a req-c1d43de9-7ed5-4a7f-b7b3-fd53821acd0f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396576
May 20 16:19:07.266548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0107f369-034f-4eb3-a927-f2bdcf58fc9f req-846776f6-999e-4802-b5bf-b1127e00ad82 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:07.268027 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0107f369-034f-4eb3-a927-f2bdcf58fc9f req-846776f6-999e-4802-b5bf-b1127e00ad82 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0888524
May 20 16:19:07.312596 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0107f369-034f-4eb3-a927-f2bdcf58fc9f req-6506d3ff-4dfc-42c0-824a-795909a522ec tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388277
May 20 16:19:08.541450 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e3eb17-870b-4555-b8b0-60a81bf0541b req-a99d3a8f-ecde-4288-aea7-b8fc188b7589 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:08.547940 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-23e3eb17-870b-4555-b8b0-60a81bf0541b req-a99d3a8f-ecde-4288-aea7-b8fc188b7589 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.1129558
May 20 16:19:08.594260 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-23e3eb17-870b-4555-b8b0-60a81bf0541b req-840943c1-c456-4ce0-93c0-44a43181ba0b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444098
May 20 16:19:09.797703 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc62e147-130c-4f6f-abeb-65cc6a633580 req-0dca2a36-b4ea-41b4-9668-d3ebe7ad2120 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:09.799202 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cc62e147-130c-4f6f-abeb-65cc6a633580 req-0dca2a36-b4ea-41b4-9668-d3ebe7ad2120 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0852695
May 20 16:19:09.844533 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cc62e147-130c-4f6f-abeb-65cc6a633580 req-8a5d1992-9384-4226-87c0-b799a7003ddf tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396585
May 20 16:19:10.469889 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a4311-a0a6-4224-ba70-bde7213750fb req-9921abbd-5bbc-4371-a79f-1015dab5a139 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:10.471378 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-357a4311-a0a6-4224-ba70-bde7213750fb req-9921abbd-5bbc-4371-a79f-1015dab5a139 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0847590
May 20 16:19:10.516521 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-357a4311-a0a6-4224-ba70-bde7213750fb req-44ca1c36-34a1-4e64-b45f-4bfb68ff8c75 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391779
May 20 16:19:11.034500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93fb73b6-5703-423f-b9ad-dc6266d0368f req-7808aff0-139d-4c5e-a075-c93efc612d68 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:11.036018 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-93fb73b6-5703-423f-b9ad-dc6266d0368f req-7808aff0-139d-4c5e-a075-c93efc612d68 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0809283
May 20 16:19:11.088580 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-93fb73b6-5703-423f-b9ad-dc6266d0368f req-4b83c9a5-133e-404d-bb8f-8670b81fb9ec tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410523
May 20 16:19:11.705577 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbc49280-8a11-4709-bc60-a461b578124c req-ee8ce6b1-fb87-4d92-869d-5849ec53593f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:11.707070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cbc49280-8a11-4709-bc60-a461b578124c req-ee8ce6b1-fb87-4d92-869d-5849ec53593f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0788610
May 20 16:19:11.752808 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cbc49280-8a11-4709-bc60-a461b578124c req-d9a1baf4-6764-449f-a1cd-4045fb0c3e79 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399394
May 20 16:19:12.270160 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4950e0b6-a800-4520-a734-63e78cf27f5b req-bdc2a1b7-c09d-4cd9-b869-7835b8144a04 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:12.271662 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4950e0b6-a800-4520-a734-63e78cf27f5b req-bdc2a1b7-c09d-4cd9-b869-7835b8144a04 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0831470
May 20 16:19:12.316504 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4950e0b6-a800-4520-a734-63e78cf27f5b req-0c176a63-f60a-4e29-a35a-435a0bba5780 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379732
May 20 16:19:12.950648 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb45f522-8c7f-4a05-8f12-ffd7b4b83419 req-429dc61b-8a19-4c21-87ca-6f02769e7132 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:12.952227 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cb45f522-8c7f-4a05-8f12-ffd7b4b83419 req-429dc61b-8a19-4c21-87ca-6f02769e7132 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0878983
May 20 16:19:12.997422 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cb45f522-8c7f-4a05-8f12-ffd7b4b83419 req-7e6e18f7-2e5d-4ceb-b055-fd400977f3eb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390999
May 20 16:19:13.503791 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f494cd12-96d0-4809-b704-962e658a437b req-b3fe1d52-2468-4780-8983-813960026f32 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:13.505272 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f494cd12-96d0-4809-b704-962e658a437b req-b3fe1d52-2468-4780-8983-813960026f32 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0841098
May 20 16:19:13.551262 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f494cd12-96d0-4809-b704-962e658a437b req-2ff0a66e-386c-4f31-85c1-0c2cf0ca1fd7 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401995
May 20 16:19:14.184008 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bdf1e70-6f37-4d5e-96cd-dfd3ca23e8ae req-b038934e-7b64-4e3b-8e38-0583189ef10f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:14.185455 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5bdf1e70-6f37-4d5e-96cd-dfd3ca23e8ae req-b038934e-7b64-4e3b-8e38-0583189ef10f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0790658
May 20 16:19:14.233657 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5bdf1e70-6f37-4d5e-96cd-dfd3ca23e8ae req-7a4bf6c5-8596-41f7-84d4-1605255fe5c4 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422807
May 20 16:19:14.701323 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d7e1b8b3-8705-4d1e-989b-6de8cd48c38e details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:19:14.738890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fa6875-5022-4798-bc7f-7c3b27ab0bcf req-86f2bc8e-e6d2-436c-ab32-2c768a70808e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:14.740728 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-43fa6875-5022-4798-bc7f-7c3b27ab0bcf req-86f2bc8e-e6d2-436c-ab32-2c768a70808e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 944 time: 0.0819817
May 20 16:19:14.784704 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-43fa6875-5022-4798-bc7f-7c3b27ab0bcf req-fa4d932d-d5f6-4dd0-b93b-e2a65047fd1b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375772
May 20 16:19:14.858377 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:19:14.871701 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e', 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880', 'port_id': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e', 'mac_address': 'fa:16:3e:36:27:02', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 643, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '119e0a0a-4f75-4580-afee-ce96f3e12878', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:19:14.924310 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:14.941265 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d7e1b8b3-8705-4d1e-989b-6de8cd48c38e {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:19:14.958114 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:19:15.098965 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:15.103470 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:15.171215 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:15.178735 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.179099 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.179467 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.179811 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.180114 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.180527 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.180847 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.181167 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.181483 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.181795 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.182105 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.182414 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:15.187109 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:15.434194 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff485dab-bffb-4f13-875d-e77debcac91a req-4810d8ac-9674-4e56-81c2-4edb79f29e76 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:15.435613 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff485dab-bffb-4f13-875d-e77debcac91a req-4810d8ac-9674-4e56-81c2-4edb79f29e76 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0900373
May 20 16:19:15.480620 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff485dab-bffb-4f13-875d-e77debcac91a req-b794a6c4-5021-4486-b707-e2b53fd6d0df tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388143
May 20 16:19:15.885441 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-760531e6-0178-4fb1-8f33-f11c7bcbc303 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:15.974288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e1efe6-0400-49ba-aebe-2a0bc0343c03 req-69857e34-28d7-46df-ad0a-c1b48d1cabc1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:15.975814 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d8e1efe6-0400-49ba-aebe-2a0bc0343c03 req-69857e34-28d7-46df-ad0a-c1b48d1cabc1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 945 time: 0.0814874
May 20 16:19:16.022739 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d8e1efe6-0400-49ba-aebe-2a0bc0343c03 req-e15aa169-5387-4614-be4d-5a7fa646e976 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410480
May 20 16:19:16.537731 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-481a2aa6-1d61-4275-96c5-536547056115 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:16.540207 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-481a2aa6-1d61-4275-96c5-536547056115 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.0745187
May 20 16:19:16.734700 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c0965e-685b-4905-8aed-49561a40943e req-349daa04-ccbf-44fe-a738-bac9d8b7e281 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:16.736235 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e7c0965e-685b-4905-8aed-49561a40943e req-349daa04-ccbf-44fe-a738-bac9d8b7e281 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1476667
May 20 16:19:16.764850 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-97932897-92fb-4614-8487-7c7547f29874 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:16.766345 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-97932897-92fb-4614-8487-7c7547f29874 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.1380310
May 20 16:19:16.781412 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e7c0965e-685b-4905-8aed-49561a40943e req-6a6ac4d8-f811-40f5-9415-117bf6c7756f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391023
May 20 16:19:16.914319 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-91234fb1-73af-4559-9858-a04b08edb291 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 217 time: 0.1409633
May 20 16:19:16.977515 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-f7603b2d-c7f3-4492-97ae-4cbbe7d3d4ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:16.979023 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-f7603b2d-c7f3-4492-97ae-4cbbe7d3d4ab service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0580640
May 20 16:19:17.027773 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-b6b75acf-d442-4cec-999a-64b146d30d03 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0412052
May 20 16:19:17.165159 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-37cdd7b4-4c75-44d0-b9df-262eb6666f92 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1304424
May 20 16:19:17.221143 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f020ada-b8ee-457f-afd5-95ede6ad6609 req-b76a45e2-86ad-4cae-99a9-3d5e2a926553 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:17.222615 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5f020ada-b8ee-457f-afd5-95ede6ad6609 req-b76a45e2-86ad-4cae-99a9-3d5e2a926553 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 945 time: 0.0882888
May 20 16:19:17.276686 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5f020ada-b8ee-457f-afd5-95ede6ad6609 req-3963395c-319f-49fd-a1be-355103022cc6 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0477655
May 20 16:19:17.315698 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d9dd8bce-b933-4c46-bc09-428ab00d40e3 req-b5df1454-4124-4725-8eac-615807972f98 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1438472
May 20 16:19:17.798516 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['d7e1b8b3-8705-4d1e-989b-6de8cd48c38e'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:19:17.982402 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe59f1d-673c-4e94-92ea-43ba2a81c707 req-cad1d495-80eb-4dfe-b88f-861be3fe43d3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:17.984034 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7fe59f1d-673c-4e94-92ea-43ba2a81c707 req-cad1d495-80eb-4dfe-b88f-861be3fe43d3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0852313
May 20 16:19:18.031092 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7fe59f1d-673c-4e94-92ea-43ba2a81c707 req-c513bf7c-6388-45aa-adfc-cf6062bac7ed tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409210
May 20 16:19:18.456930 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:18.486196 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e3eee5-ac4a-4265-9b5e-be0e6b36591a req-6b89cc25-65e0-4ccc-afe5-4b9f3ef01c00 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:18.487947 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-78e3eee5-ac4a-4265-9b5e-be0e6b36591a req-6b89cc25-65e0-4ccc-afe5-4b9f3ef01c00 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 945 time: 0.0963860
May 20 16:19:18.536052 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-78e3eee5-ac4a-4265-9b5e-be0e6b36591a req-8c47041f-2a66-46e9-9e88-7c0cb6abdf4a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415719
May 20 16:19:18.628438 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-562908ef-cb03-4d10-b992-959548539d60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:19.228960 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520dfd66-99e5-41e4-afc2-430fdeb25fff req-0e79bb1c-124c-4e73-85f4-1874be2fac43 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:19.230497 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-520dfd66-99e5-41e4-afc2-430fdeb25fff req-0e79bb1c-124c-4e73-85f4-1874be2fac43 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0828891
May 20 16:19:19.278582 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-520dfd66-99e5-41e4-afc2-430fdeb25fff req-60fad3e6-e45f-430b-8d1c-8419369a6563 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418971
May 20 16:19:19.630502 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:19.739723 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6aa6b4c-c23e-49de-87cc-5a65f5c427bc req-bb636b0e-1759-48b3-a2af-cf47c493edfa tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:19.741417 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6aa6b4c-c23e-49de-87cc-5a65f5c427bc req-bb636b0e-1759-48b3-a2af-cf47c493edfa tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 945 time: 0.0867729
May 20 16:19:19.786358 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6aa6b4c-c23e-49de-87cc-5a65f5c427bc req-2ba2a520-275e-4a48-ac41-1ec17a37f3a8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383708
May 20 16:19:20.472650 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c2ca5b-8d60-437c-9026-35169b932643 req-fbdb747d-af76-4fab-9f6a-f02f2355e9a5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:20.474044 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9c2ca5b-8d60-437c-9026-35169b932643 req-fbdb747d-af76-4fab-9f6a-f02f2355e9a5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0833089
May 20 16:19:20.519376 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9c2ca5b-8d60-437c-9026-35169b932643 req-8d5ec346-0f9a-4c22-97ce-8f530d34385b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392396
May 20 16:19:20.602199 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d7e1b8b3-8705-4d1e-989b-6de8cd48c38e up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:19:20.794378 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:19:20.800585 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:19:20.800967 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:20.931550 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:20.961495 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:19:20.973995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:19:20.998396 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1170504b-d5e3-41f7-ac9b-34185cebae58 req-f5a86eae-ec51-4d58-bd39-2a2458ae4a7f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:20.999937 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1170504b-d5e3-41f7-ac9b-34185cebae58 req-f5a86eae-ec51-4d58-bd39-2a2458ae4a7f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 945 time: 0.0944138
May 20 16:19:21.045369 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1170504b-d5e3-41f7-ac9b-34185cebae58 req-6308695f-fb33-4a9b-9590-cf769cc2e5ac tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395756
May 20 16:19:21.099103 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e', 'code': 200}
May 20 16:19:21.158953 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:21.162583 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-b3894b79-7da6-4072-ae7d-b4e2203f9edf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:21.239424 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:21.243046 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:21.296520 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:21.716302 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e88877-8638-4c97-8ad4-e3891272bf85 req-34e28886-a48f-4edf-bca0-3349b9b0d3e2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:21.717779 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-74e88877-8638-4c97-8ad4-e3891272bf85 req-34e28886-a48f-4edf-bca0-3349b9b0d3e2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0876777
May 20 16:19:21.765048 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-74e88877-8638-4c97-8ad4-e3891272bf85 req-a780fc29-2a34-4502-88f1-14577cbf2d89 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413127
May 20 16:19:22.235445 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75395585-f7f7-4940-80a0-cb9ea947c154 req-f09a909c-c933-4aea-b758-f2946f75a3e8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:22.236919 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75395585-f7f7-4940-80a0-cb9ea947c154 req-f09a909c-c933-4aea-b758-f2946f75a3e8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0799036
May 20 16:19:22.285612 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75395585-f7f7-4940-80a0-cb9ea947c154 req-eab865d4-04ec-4fe6-a1f9-e29b94c9f282 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426562
May 20 16:19:22.959400 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d085771-dd5b-48aa-9f1b-4ade9d3433f9 req-1ac5fdb2-116e-4197-bb1f-fb2a130f447b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:22.960876 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1d085771-dd5b-48aa-9f1b-4ade9d3433f9 req-1ac5fdb2-116e-4197-bb1f-fb2a130f447b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0791159
May 20 16:19:22.962554 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:19:23.008947 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1d085771-dd5b-48aa-9f1b-4ade9d3433f9 req-5b59ae66-c367-4e45-8de6-f35abb2c9e76 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406256
May 20 16:19:23.470301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98506ae4-5538-46d5-8e15-df6523ebd128 req-881eab75-b695-481e-8cb3-bd296cf2937a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:23.471672 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98506ae4-5538-46d5-8e15-df6523ebd128 req-881eab75-b695-481e-8cb3-bd296cf2937a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0818095
May 20 16:19:23.514540 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98506ae4-5538-46d5-8e15-df6523ebd128 req-37c7ff23-b8d5-42fa-91bb-3c53cff8165a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0371814
May 20 16:19:24.194789 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abb0d15d-e2d7-4242-9aca-f67d3cbc5760 req-d20661be-9bc4-442f-beaa-cfdf3d37551e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:24.196285 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-abb0d15d-e2d7-4242-9aca-f67d3cbc5760 req-d20661be-9bc4-442f-beaa-cfdf3d37551e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0815752
May 20 16:19:24.242085 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-abb0d15d-e2d7-4242-9aca-f67d3cbc5760 req-06d159a0-a383-417c-a6f6-4621e9b81555 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396996
May 20 16:19:24.702751 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35518e4-c1f6-40b4-bb28-509e32e362ef req-a33f5508-97fe-4631-addb-2daa1f173e52 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:24.704219 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c35518e4-c1f6-40b4-bb28-509e32e362ef req-a33f5508-97fe-4631-addb-2daa1f173e52 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0816269
May 20 16:19:24.748582 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c35518e4-c1f6-40b4-bb28-509e32e362ef req-42c510fb-cb52-4648-9d6b-09540d91fda4 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386720
May 20 16:19:25.428316 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b10f6e7-a552-411a-a2b7-22c972addebb req-083e8621-ad19-441f-b8c8-e285c125c9aa tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:25.429671 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b10f6e7-a552-411a-a2b7-22c972addebb req-083e8621-ad19-441f-b8c8-e285c125c9aa tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0794380
May 20 16:19:25.475387 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b10f6e7-a552-411a-a2b7-22c972addebb req-77de9935-9253-40b0-8e25-b61df5c72d03 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399451
May 20 16:19:25.930845 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d06408-801d-45e5-9526-25a4f20cb8a3 req-a1f9c0c4-73dd-45a6-9257-ee12b436337f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:25.932367 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2d06408-801d-45e5-9526-25a4f20cb8a3 req-a1f9c0c4-73dd-45a6-9257-ee12b436337f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0803778
May 20 16:19:25.978292 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2d06408-801d-45e5-9526-25a4f20cb8a3 req-3a148ca7-4cbf-4f7b-bf88-b10a388489e3 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393646
May 20 16:19:26.665670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d37a90f-efcd-45c1-b318-013b4a257571 req-17cdcab9-37f7-4aaa-b077-460b44e0332b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:26.667036 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d37a90f-efcd-45c1-b318-013b4a257571 req-17cdcab9-37f7-4aaa-b077-460b44e0332b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0828388
May 20 16:19:26.711430 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d37a90f-efcd-45c1-b318-013b4a257571 req-b5031465-b111-49d8-8a1e-5eb03407f33a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386343
May 20 16:19:26.958531 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3081124e-6185-4fb1-b826-5682b9ee9ee5 req-e05909c9-0df9-4dcf-8e52-de328832636d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:26.960036 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3081124e-6185-4fb1-b826-5682b9ee9ee5 req-e05909c9-0df9-4dcf-8e52-de328832636d service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 1099 time: 0.0747755
May 20 16:19:27.006019 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3081124e-6185-4fb1-b826-5682b9ee9ee5 req-15bac43b-880e-41ca-a89c-ceb4a05fc0d6 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389810
May 20 16:19:27.165752 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ff9693-f686-4d79-b977-bfcc1278fdee req-41f3c1af-896e-433f-8318-42fba98dbd52 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:27.167789 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-79ff9693-f686-4d79-b977-bfcc1278fdee req-41f3c1af-896e-433f-8318-42fba98dbd52 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0825739
May 20 16:19:27.213393 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-79ff9693-f686-4d79-b977-bfcc1278fdee req-1b0cd48d-e561-4e8e-9e66-3890a0d01722 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395899
May 20 16:19:27.957046 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d835aee-3885-429f-8d94-bbb572cde21a req-274fc3cf-7161-464a-b6eb-c9c39562f2e8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:27.959130 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d835aee-3885-429f-8d94-bbb572cde21a req-274fc3cf-7161-464a-b6eb-c9c39562f2e8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1396537
May 20 16:19:28.005809 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d835aee-3885-429f-8d94-bbb572cde21a req-1c212450-ce12-49ad-a3d9-60d74e1966ea tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413754
May 20 16:19:28.399598 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1714c4eb-1c9f-40d4-a16c-a7517d0e9587 req-eb102810-c9b5-4671-b268-2a7f98a35233 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:28.401203 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1714c4eb-1c9f-40d4-a16c-a7517d0e9587 req-eb102810-c9b5-4671-b268-2a7f98a35233 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0810008
May 20 16:19:28.451516 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1714c4eb-1c9f-40d4-a16c-a7517d0e9587 req-54519510-5fd0-4115-85dc-abbfea66c97b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434904
May 20 16:19:28.567259 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:29.208753 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae2724d9-28f6-4eb5-8e1b-8295d64f7c0e req-8f3cf1dc-5d45-46d5-9e86-0ee0ee4038d3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:29.210330 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ae2724d9-28f6-4eb5-8e1b-8295d64f7c0e req-8f3cf1dc-5d45-46d5-9e86-0ee0ee4038d3 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0926840
May 20 16:19:29.258433 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ae2724d9-28f6-4eb5-8e1b-8295d64f7c0e req-1c9e61e9-4bcf-4289-b001-4ac2cdba77f4 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418210
May 20 16:19:29.670190 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475e564f-db82-4aa1-ab6d-7f0542566353 req-c7bb58be-5f39-4b92-b5f2-d0458191221e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:29.671694 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-475e564f-db82-4aa1-ab6d-7f0542566353 req-c7bb58be-5f39-4b92-b5f2-d0458191221e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.1053228
May 20 16:19:29.722004 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-475e564f-db82-4aa1-ab6d-7f0542566353 req-6f082bab-f422-48a5-afb5-eec28c0095f2 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441546
May 20 16:19:30.456549 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdd246c-ed9b-428b-9f1f-bf23c03f2831 req-e9436fe9-4655-49e2-a79b-b5a48ff202c5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:30.458070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1bdd246c-ed9b-428b-9f1f-bf23c03f2831 req-e9436fe9-4655-49e2-a79b-b5a48ff202c5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0818305
May 20 16:19:30.508155 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1bdd246c-ed9b-428b-9f1f-bf23c03f2831 req-27d18c70-0001-47f3-ae40-52528644a7b9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434852
May 20 16:19:30.915609 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd3678b-2fbd-4376-b8e4-1a88f9cf667c req-9cf5d389-24cb-40a1-84be-72bd103cd1db tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:30.921084 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bd3678b-2fbd-4376-b8e4-1a88f9cf667c req-9cf5d389-24cb-40a1-84be-72bd103cd1db tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0909777
May 20 16:19:30.965843 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bd3678b-2fbd-4376-b8e4-1a88f9cf667c req-9f3dc850-bdd7-4340-8552-6e427a7dabbd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407557
May 20 16:19:31.156001 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-589eb88c-11a6-406c-84cb-c3923adbbc50 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:31.157445 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-589eb88c-11a6-406c-84cb-c3923adbbc50 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.1539392
May 20 16:19:31.173350 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-62d83879-1a78-46d9-8498-0a1dff655c79 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/quotas/747fc4332771467fa24e6bc07899b54f HTTP/1.1" status: 200  len: 375 time: 0.0099518
May 20 16:19:31.265399 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-cddaad3c-08bd-4d59-b509-fe41a778389b tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0864723
May 20 16:19:31.405276 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-81fc85a4-843b-405f-b06e-9530b242b97d service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1328270
May 20 16:19:31.540498 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-ae1c37c7-777d-4611-badd-b0948451559e service neutron] 10.222.0.64 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1293640
May 20 16:19:31.711166 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48bb3dc-0089-46fe-950f-32a8d32fdd23 req-0ff36eda-5d91-42a2-aa10-adc514158ec1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:31.712772 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c48bb3dc-0089-46fe-950f-32a8d32fdd23 req-0ff36eda-5d91-42a2-aa10-adc514158ec1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0860157
May 20 16:19:31.760016 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c48bb3dc-0089-46fe-950f-32a8d32fdd23 req-edefae53-eaae-4114-98dd-84719d020125 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413687
May 20 16:19:31.895730 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-acbbdcea-cd6c-4148-b843-66d6bda9d76b req-03ae0ae0-5e93-433e-9196-b7932edf70cf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0549712
May 20 16:19:32.950698 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed7fe2da-95b1-445e-843a-019f23bda38e req-5d899b0a-ae9d-4fdf-b477-ec68fabd694a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:32.952219 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ed7fe2da-95b1-445e-843a-019f23bda38e req-5d899b0a-ae9d-4fdf-b477-ec68fabd694a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0803614
May 20 16:19:32.999838 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ed7fe2da-95b1-445e-843a-019f23bda38e req-dbb9f539-2fb2-425b-8aa9-5f7b87c84bc5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417578
May 20 16:19:33.062929 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c9452907-cce1-4a14-a505-b1c83bb4b8fb req-9a4ac029-34b7-4059-871a-6305bade6f9c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0455637
May 20 16:19:34.192500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-582a3237-2d6b-4e70-940d-d6e6d877dd90 req-6f5f5c87-4433-4ded-9d3e-94eddbd90d6a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:34.193984 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-582a3237-2d6b-4e70-940d-d6e6d877dd90 req-6f5f5c87-4433-4ded-9d3e-94eddbd90d6a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0835376
May 20 16:19:34.238924 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-582a3237-2d6b-4e70-940d-d6e6d877dd90 req-9556e11e-5d65-42da-bf85-be7cdc7e12c1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390167
May 20 16:19:34.384095 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dc40d463-c573-4a23-a302-e34e18f087e6 req-2f3c64f7-b199-4fdc-924b-773cc0dc1392 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0409243
May 20 16:19:35.426570 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6ca707-5d6d-4ee5-a6d6-5a7aff630653 req-0134e4ab-da08-4609-be7c-0edd952aeb4e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:35.428030 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0e6ca707-5d6d-4ee5-a6d6-5a7aff630653 req-0134e4ab-da08-4609-be7c-0edd952aeb4e tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0823786
May 20 16:19:35.473170 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0e6ca707-5d6d-4ee5-a6d6-5a7aff630653 req-c3c7f9c1-e158-4b84-a570-ef942be43f5b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394459
May 20 16:19:35.608252 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4f189e11-ff54-4b1d-a0c3-68fd64fdcb9a req-fbb095db-0f7f-4530-ae01-88af1e5fa6c9 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0416272
May 20 16:19:36.718845 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892cd11d-001b-42c0-995b-6ab52e46a238 req-97c7502a-e696-4bd9-ae0b-ae58878e5ae1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:36.720355 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-892cd11d-001b-42c0-995b-6ab52e46a238 req-97c7502a-e696-4bd9-ae0b-ae58878e5ae1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1423614
May 20 16:19:36.765939 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-892cd11d-001b-42c0-995b-6ab52e46a238 req-6ce10ea1-617e-4d6a-a40b-2cd30eec3510 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397503
May 20 16:19:36.900589 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-da5d67eb-8d33-4a05-960a-edc3065fbc25 req-00de49b9-8d01-4ba9-851d-179a906279ad tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0435202
May 20 16:19:37.949855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47071ab0-f078-47dc-b4cd-ee5336e8574a req-3a049bf7-9037-442f-9928-0c01b0986a53 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:37.951397 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-47071ab0-f078-47dc-b4cd-ee5336e8574a req-3a049bf7-9037-442f-9928-0c01b0986a53 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0780098
May 20 16:19:37.994125 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-47071ab0-f078-47dc-b4cd-ee5336e8574a req-39419105-47b9-4525-bcdc-c7aa0ed762e0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0371084
May 20 16:19:38.132301 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-56d32c73-7dea-438a-911f-cd28cca4f5db req-8410cf1e-6767-4488-9bf6-5f34147ea5f1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0427859
May 20 16:19:39.199150 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2294a0d4-371b-4785-bb80-462789972e2a req-60fb8d05-bcab-4b9d-829d-4b21b77e460b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:39.200996 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2294a0d4-371b-4785-bb80-462789972e2a req-60fb8d05-bcab-4b9d-829d-4b21b77e460b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0953031
May 20 16:19:39.281628 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2294a0d4-371b-4785-bb80-462789972e2a req-0d0fb7d5-4148-45b4-b732-b7915dc1c431 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0749710
May 20 16:19:39.294745 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-397d8189-5bd2-4365-86bb-7a27d48ab300 req-4bf56554-1fbd-4694-b9be-7ed9f81a2b6d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0460522
May 20 16:19:40.484489 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b761a650-cda9-42a5-9baa-7d067cb7369b req-6f9289d3-2e5d-4103-9e22-381e17f179a4 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0557592
May 20 16:19:40.524304 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38430e51-9f3e-47d9-ab37-638168274a7c req-438ce3b1-8b78-4383-ad32-be77eb465890 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:40.524304 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-38430e51-9f3e-47d9-ab37-638168274a7c req-438ce3b1-8b78-4383-ad32-be77eb465890 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1323981
May 20 16:19:40.578707 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-38430e51-9f3e-47d9-ab37-638168274a7c req-8e072e5f-7e9e-4ab4-b987-d8198630b30f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0465195
May 20 16:19:41.086934 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-52668715-baa2-48e1-a320-0bfeb524f824 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:41.088385 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-52668715-baa2-48e1-a320-0bfeb524f824 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/networks?id=7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 200  len: 815 time: 0.1456947
May 20 16:19:41.100978 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Request body: {'port': {'device_id': '7902b3ab-c575-46b6-853a-8705c994ff11', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'admin_state_up': True, 'tenant_id': '747fc4332771467fa24e6bc07899b54f'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:19:41.243083 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:41.252557 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Usage tracker for resource:port and tenant:747fc4332771467fa24e6bc07899b54f is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:41.256678 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:41.263569 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:41.417695 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7478c316-add3-40a3-b1a9-195c9d6aadff req-5a4ddb0d-6911-4e42-a2b3-d4f051b5ebad tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:41.419084 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7478c316-add3-40a3-b1a9-195c9d6aadff req-5a4ddb0d-6911-4e42-a2b3-d4f051b5ebad tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0806122
May 20 16:19:41.464530 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7478c316-add3-40a3-b1a9-195c9d6aadff req-87464894-24c9-40a5-9c11-0c2ce230fc89 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388572
May 20 16:19:41.467543 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Made reservation on behalf of 747fc4332771467fa24e6bc07899b54f for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:19:41.471457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:41.640688 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Allocated IP 172.20.0.6 (7250e4c3-f4ff-4878-8316-65dfc0975bd3/924a520e-53e5-4777-beb9-f9e6d0bd0dff/51bfa597-72ba-47c7-b8e7-ebd34fd1b827) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:19:41.656230 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d48bbdc9-c06e-414a-b520-a8801e5192c0 req-ae3cb57e-445a-427b-8f32-e1cec972d774 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0466905
May 20 16:19:41.779247 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d8c22b-4c7c-4422-b450-f4e82232e580 req-0ca2700d-c275-43c5-98df-c74fed534768 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:41.781169 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9d8c22b-4c7c-4422-b450-f4e82232e580 req-0ca2700d-c275-43c5-98df-c74fed534768 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0884972
May 20 16:19:41.826547 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9d8c22b-4c7c-4422-b450-f4e82232e580 req-09f1632c-10f9-4f6f-a370-9be19e1254cf tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397363
May 20 16:19:41.873463 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:42.082326 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:42.088370 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2d772ca8-df08-41cc-8b70-5ef284a14cdc tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:42.095030 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f', 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', '5948d4d9-4307-4294-a458-260cc0b0d3d4'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:19:42.160045 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:19:42.163485 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:19:42.168190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:19:42.205747 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event updated for resources: {'Port': ['ID=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:42.224986 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.225359 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.225745 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.226102 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.226457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.226940 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.227159 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.227614 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.227994 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.228350 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.228801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.229146 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:42.235728 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:42.252841 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:42.253603 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:42.391458 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2940385
May 20 16:19:42.410839 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Request body: {'port': {'device_id': '7902b3ab-c575-46b6-853a-8705c994ff11', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:19:42.531599 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:42.679491 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be76d7f4-5ce7-4821-9036-38db73cd52f8 req-4b3cff02-9a2d-4b64-ad6b-47ac060ebf5f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:42.685148 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-be76d7f4-5ce7-4821-9036-38db73cd52f8 req-4b3cff02-9a2d-4b64-ad6b-47ac060ebf5f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0994027
May 20 16:19:42.734259 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-be76d7f4-5ce7-4821-9036-38db73cd52f8 req-9315eb6a-5f77-417d-891f-5bc8c20a172d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470896
May 20 16:19:42.896650 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c9705b-3c32-492b-9f8a-51b53a733ad9 req-4baaf5a1-d736-424d-a632-d089194c7659 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:42.898433 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-46c9705b-3c32-492b-9f8a-51b53a733ad9 req-4baaf5a1-d736-424d-a632-d089194c7659 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 931 time: 0.1016128
May 20 16:19:42.995829 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:19:43.003608 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:43.007944 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-46c9705b-3c32-492b-9f8a-51b53a733ad9 req-7d1198dc-fdff-4bfc-af74-ebb01f1ba4ab tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1036885
May 20 16:19:43.025644 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Transition to ACTIVE for port object 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:19:43.051281 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d7715e-6a6f-4232-bec6-789509bf02d3 req-249befd0-29b7-434e-8039-7a5507f8b133 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:43.055344 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-11d7715e-6a6f-4232-bec6-789509bf02d3 req-249befd0-29b7-434e-8039-7a5507f8b133 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0993071
May 20 16:19:43.098301 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-11d7715e-6a6f-4232-bec6-789509bf02d3 req-a733c6f5-87fa-4d6f-a2ad-ed6802ac1cae tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390456
May 20 16:19:43.196139 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:43.200971 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:43.373341 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Pushing event updated for resources: {'Port': ['ID=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:43.403769 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:43.450508 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Attempting to bind port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:19:43.450846 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Attempting to bind port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:19:43.451200 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Attempting to bind port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:19:43.455940 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:19:43.456259 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Attempting to bind port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 on network 7250e4c3-f4ff-4878-8316-65dfc0975bd3 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:19:43.461882 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 19, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:19:43.462216 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Checking segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:19:43.462678 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Bound using segment: {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:19:43.463065 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Bound port: 51bfa597-72ba-47c7-b8e7-ebd34fd1b827, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6b15b2ba-0475-4448-8bb1-4db4352f2b43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 608, 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:19:43.463390 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:43.553970 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] For port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:19:43.556958 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] For port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:19:43.673872 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:43.678691 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3f06fdd0-f6ac-4563-b1c5-75f89d45b41a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:43.735686 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:43.736294 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:43.737646 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] 10.222.0.16 "PUT /v2.0/ports/51bfa597-72ba-47c7-b8e7-ebd34fd1b827 HTTP/1.1" status: 200  len: 1093 time: 1.3375058
May 20 16:19:43.738125 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7902b3ab-c575-46b6-853a-8705c994ff11', 'tag': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:19:43.757974 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Pushing event updated for resources: {'Port': ['ID=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:43.761474 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:43.784634 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7902b3ab-c575-46b6-853a-8705c994ff11', 'tag': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827', 'status': 'completed', 'code': 200}
May 20 16:19:43.944740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d9e9c60-ad54-4216-8821-a2c2d43e0e8e req-723dece2-3dab-4409-9968-883b0ef3a254 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:43.946223 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6d9e9c60-ad54-4216-8821-a2c2d43e0e8e req-723dece2-3dab-4409-9968-883b0ef3a254 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.1380858
May 20 16:19:43.948058 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c0e737-3dba-421e-b614-00115292023f req-d7f9c2cd-3038-4866-b46c-9e6192ad6959 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:43.949395 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-22c0e737-3dba-421e-b614-00115292023f req-d7f9c2cd-3038-4866-b46c-9e6192ad6959 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 1096 time: 0.1058989
May 20 16:19:43.982539 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd9e9e76-c03a-4bf5-bfe0-4271ef210429 req-64ac7899-265b-4604-b402-d32d11b71e05 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:43.984377 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bd9e9e76-c03a-4bf5-bfe0-4271ef210429 req-64ac7899-265b-4604-b402-d32d11b71e05 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.1133475
May 20 16:19:44.031695 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bd9e9e76-c03a-4bf5-bfe0-4271ef210429 req-56509345-73d0-47a9-b126-a73b4cc1f87a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409932
May 20 16:19:44.102351 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6d9e9c60-ad54-4216-8821-a2c2d43e0e8e req-a75cf69f-2772-471e-a9cb-975e541f9bfc service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1418438
May 20 16:19:44.144990 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c0e737-3dba-421e-b614-00115292023f req-c2d6a577-4a2c-4a0e-a938-0653a88f2b2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:44.146797 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-22c0e737-3dba-421e-b614-00115292023f req-c2d6a577-4a2c-4a0e-a938-0653a88f2b2c service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=747fc4332771467fa24e6bc07899b54f&shared=False HTTP/1.1" status: 200  len: 916 time: 0.1681907
May 20 16:19:44.206719 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b37438-6cca-4e32-abad-dde6929c2f74 req-ad724946-ac5b-40ce-a724-64c1d6b6154d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:44.208195 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2b37438-6cca-4e32-abad-dde6929c2f74 req-ad724946-ac5b-40ce-a724-64c1d6b6154d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 943 time: 0.0798094
May 20 16:19:44.257868 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2b37438-6cca-4e32-abad-dde6929c2f74 req-4dceb4e6-e9f8-40bb-9344-ea66ab3170cd tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428276
May 20 16:19:44.473968 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac787fb9-b760-4559-859e-30c181758945 req-cb2fd83d-29b5-4156-a742-13f4ae772571 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:44.473968 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac787fb9-b760-4559-859e-30c181758945 req-cb2fd83d-29b5-4156-a742-13f4ae772571 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0903707
May 20 16:19:44.502543 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac787fb9-b760-4559-859e-30c181758945 req-9dcb4c35-d4ae-434a-bcbe-ee9a9d66acdb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445075
May 20 16:19:44.762888 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c0e737-3dba-421e-b614-00115292023f req-3451a4fb-87aa-41f3-8f48-8f2ff00ef76d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:44.764349 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-22c0e737-3dba-421e-b614-00115292023f req-3451a4fb-87aa-41f3-8f48-8f2ff00ef76d service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1364295
May 20 16:19:44.908907 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-e37da557-52a5-4358-8df5-89f604fb3218 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:44.910304 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-e37da557-52a5-4358-8df5-89f604fb3218 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=747fc4332771467fa24e6bc07899b54f&device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 1096 time: 0.0750592
May 20 16:19:45.009113 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-5c0a4bfa-366f-40ce-b9a6-643630d56314 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=51bfa597-72ba-47c7-b8e7-ebd34fd1b827 HTTP/1.1" status: 200  len: 217 time: 0.0606918
May 20 16:19:45.078392 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-77cb86f1-e90d-432d-9161-17021484b0cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:45.080634 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-77cb86f1-e90d-432d-9161-17021484b0cf service neutron] 10.222.0.16 "GET /v2.0/subnets?id=924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 200  len: 855 time: 0.0645962
May 20 16:19:45.141279 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-c3d886dc-591f-45cb-9a63-aae38e4c3d96 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=7250e4c3-f4ff-4878-8316-65dfc0975bd3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0506070
May 20 16:19:45.269034 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d31fc7-f58b-4dd7-af04-6ab95508a2a6 req-db072009-bd34-44d3-bd1e-bf8b76f70c0e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:45.278606 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b9d31fc7-f58b-4dd7-af04-6ab95508a2a6 req-db072009-bd34-44d3-bd1e-bf8b76f70c0e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.0985577
May 20 16:19:45.288826 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-ce5fa339-15ae-4e0d-bb96-242497a76d0d service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1406164
May 20 16:19:45.352108 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b9d31fc7-f58b-4dd7-af04-6ab95508a2a6 req-c16997c5-6107-41e5-add5-d0f40d5e0d99 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0679860
May 20 16:19:45.453430 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceaa00b3-80ea-4d18-b2a7-0ed4e12f3f68 req-e2d4e5f4-b60f-4098-9726-6b77bd34d0c0 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:45.456233 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ceaa00b3-80ea-4d18-b2a7-0ed4e12f3f68 req-e2d4e5f4-b60f-4098-9726-6b77bd34d0c0 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 943 time: 0.0849972
May 20 16:19:45.506561 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ceaa00b3-80ea-4d18-b2a7-0ed4e12f3f68 req-e6216d1a-960b-42e5-ab73-1f70a062798d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439420
May 20 16:19:45.554834 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-614a4e28-1914-4373-9d4c-c24052bd9495 req-710637a6-a820-425b-bf2c-b62d8a4b348c service neutron] 10.222.0.16 "GET /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2589817
May 20 16:19:45.576163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-4214dcda-5cca-421b-86e0-9961c6c10779 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:45.576849 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-4214dcda-5cca-421b-86e0-9961c6c10779 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Synchronizing usage tracker for tenant:bfea173096cf4b509735ffd535193ea5 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:19:45.761540 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-4214dcda-5cca-421b-86e0-9961c6c10779 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Unset dirty status for tenant:bfea173096cf4b509735ffd535193ea5 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:19:45.763036 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-4214dcda-5cca-421b-86e0-9961c6c10779 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 946 time: 0.3798568
May 20 16:19:45.781899 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4943cc66-292b-4e76-9878-0ac12a964939 req-772c5ace-7a3f-4e4f-81be-1f879d37dbc8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:45.787868 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4943cc66-292b-4e76-9878-0ac12a964939 req-772c5ace-7a3f-4e4f-81be-1f879d37dbc8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1486390
May 20 16:19:45.842492 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4943cc66-292b-4e76-9878-0ac12a964939 req-2beef412-f522-41d7-8ca2-e33161c9f546 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0482857
May 20 16:19:45.908006 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Deleting port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:19:45.908350 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:45.927318 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-fb314b9a-61b6-411b-bce3-b3ce47559714 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:46.039128 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] For port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:19:46.039508 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:46.164142 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Calling delete_port for d7e1b8b3-8705-4d1e-989b-6de8cd48c38e owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:19:46.424631 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:46.430522 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:46.442038 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['d7e1b8b3-8705-4d1e-989b-6de8cd48c38e'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:19:46.506709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Pushing event deleted for resources: {'Port': ['ID=d7e1b8b3-8705-4d1e-989b-6de8cd48c38e,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:46.508412 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5fa84309-b98d-4c9a-a60b-12ec0d5c8b85 req-60a46b1e-3c8b-4fca-84bc-eea6fdae96db tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 210 time: 0.0471690
May 20 16:19:46.509976 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:46.586715 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] No DVR routers for this DVR port d7e1b8b3-8705-4d1e-989b-6de8cd48c38e on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:19:46.590542 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:46.594894 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'name': 'network-vif-deleted', 'tag': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:19:46.650876 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd084772-ebc7-43b9-b174-dcf33a84432a', 'name': 'network-vif-deleted', 'tag': 'd7e1b8b3-8705-4d1e-989b-6de8cd48c38e', 'status': 'completed', 'code': 200}
May 20 16:19:46.699816 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a17db8-a245-4615-981d-dfbdae8cfd83 req-760d370a-ab41-4c4b-9a84-29fbfa9cdf70 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:46.701320 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19a17db8-a245-4615-981d-dfbdae8cfd83 req-760d370a-ab41-4c4b-9a84-29fbfa9cdf70 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 943 time: 0.0846076
May 20 16:19:46.736797 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-757bf0db-1d4f-4159-af3f-9426ac92f407 req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "DELETE /v2.0/ports/d7e1b8b3-8705-4d1e-989b-6de8cd48c38e HTTP/1.1" status: 204  len: 173 time: 0.9669163
May 20 16:19:46.746931 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19a17db8-a245-4615-981d-dfbdae8cfd83 req-8f1d704f-4e76-49bf-b354-fcf2c354a177 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397961
May 20 16:19:47.034886 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed6860d-21ae-47e1-8f9b-bb5191117f89 req-f7c26810-8505-4f97-885b-158b6745501d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:47.036425 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ed6860d-21ae-47e1-8f9b-bb5191117f89 req-f7c26810-8505-4f97-885b-158b6745501d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0820172
May 20 16:19:47.085522 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ed6860d-21ae-47e1-8f9b-bb5191117f89 req-0732fc08-9673-49a0-af17-4481898e8896 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428720
May 20 16:19:47.678505 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ad589aa-74bf-45ec-a13a-c5e03b0cfabb req-b30f6d60-fa26-40df-9c12-17b7a6f758ca tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=fd084772-ebc7-43b9-b174-dcf33a84432a HTTP/1.1" status: 200  len: 210 time: 0.0464866
May 20 16:19:48.011021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1033d4-b3be-4246-b19a-549d916f7338 req-455b95b9-0e51-407e-933f-9ce574a73105 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:48.012650 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-db1033d4-b3be-4246-b19a-549d916f7338 req-455b95b9-0e51-407e-933f-9ce574a73105 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 943 time: 0.1505928
May 20 16:19:48.023366 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e96de32-b806-490e-a04f-11e0e705fea8 req-76fe0889-a8a0-4d44-817e-f19b7fed1ef4 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:48.023600 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-c6403860-89bc-4b7a-81a8-c3b138a9f1ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:48.024824 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8e96de32-b806-490e-a04f-11e0e705fea8 req-76fe0889-a8a0-4d44-817e-f19b7fed1ef4 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1210837
May 20 16:19:48.025195 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-c6403860-89bc-4b7a-81a8-c3b138a9f1ba service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 1098 time: 0.0797553
May 20 16:19:48.095797 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-db1033d4-b3be-4246-b19a-549d916f7338 req-ddcccbf2-f9b3-470c-8dab-5f5592953c86 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0699956
May 20 16:19:48.112407 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8e96de32-b806-490e-a04f-11e0e705fea8 req-e49da8f2-5745-4800-965a-7d63d2ec2d46 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0727699
May 20 16:19:48.186756 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-de61af19-c485-48ab-98f9-2e44c7d3c814 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:48.192122 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-de61af19-c485-48ab-98f9-2e44c7d3c814 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.1572235
May 20 16:19:48.267849 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-b829c501-2e27-428f-ace6-be26b2e813fc service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 200  len: 217 time: 0.0717206
May 20 16:19:48.319021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 32902) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:48.336953 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-74fa5155-4678-4a06-a8f1-ed473949475f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:48.338369 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-74fa5155-4678-4a06-a8f1-ed473949475f service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0642011
May 20 16:19:48.395635 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-c1df1ea7-d269-443d-8a9a-1e355fe41704 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0495219
May 20 16:19:48.468834 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:48.495495 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:48.515360 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:48.521012 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Usage tracker for resource:security_group_rule and tenant:1505c47bc73645998e52087777eaca68 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:48.525144 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:48.531542 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:48.546760 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-9ef781c0-383c-429d-a0fe-32bbbac9b1c6 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1439021
May 20 16:19:48.661131 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:48.670258 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8f0a9576-4c8e-41f4-9107-ebf38e690dad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:48.705689 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2edf215e-ae12-4787-ba99-906f002d1a06 req-771e9592-24c1-4014-a58e-298b7ccacece service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1516519
May 20 16:19:48.733841 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:19:48.737454 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d7e1b8b3-8705-4d1e-989b-6de8cd48c38e no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:19:48.755655 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:48.764774 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:48.806117 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 32920) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:48.813361 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=1505c47bc73645998e52087777eaca68&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4856937
May 20 16:19:48.817584 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dfe794e-8637-4617-8fa3-de868dfb655b,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:48.836228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.838647 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.838647 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.839702 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.840213 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.840775 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.841247 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.841686 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.842189 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.842622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.843234 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.843665 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:19:48.848538 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:48.870770 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:48.898496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:48.908024 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: d7e1b8b3-8705-4d1e-989b-6de8cd48c38e {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:19:48.908606 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d7e1b8b3-8705-4d1e-989b-6de8cd48c38e not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:19:48.937355 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:19:48.952257 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827', 'network_id': '7250e4c3-f4ff-4878-8316-65dfc0975bd3', 'port_id': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827', 'mac_address': 'fa:16:3e:f4:37:64', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 608, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '924a520e-53e5-4777-beb9-f9e6d0bd0dff', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:19:49.015822 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:49.035798 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:19:49.053919 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:19:49.087348 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:49.093773 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-891f732b-eac5-4519-8099-6a825e0a239e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:49.106860 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dfe794e-8637-4617-8fa3-de868dfb655b,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:49.109727 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:49.113590 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:49.118590 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/7dfe794e-8637-4617-8fa3-de868dfb655b HTTP/1.1" status: 204  len: 168 time: 0.3117514
May 20 16:19:49.202371 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:49.205460 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-a439e239-1d04-4d7e-b76e-71a2b3e7b22a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:49.207169 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-52af5d36-e592-4c7b-b3de-ae7d5d8617c7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:49.212598 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-a439e239-1d04-4d7e-b76e-71a2b3e7b22a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/networks?id=ff8e44fb-6ead-46de-8521-764b50418880 HTTP/1.1" status: 200  len: 808 time: 0.1797962
May 20 16:19:49.231932 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-e823b564-6fe3-4072-9318-f2df41a524df tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/quotas/bfea173096cf4b509735ffd535193ea5 HTTP/1.1" status: 200  len: 375 time: 0.0183787
May 20 16:19:49.282117 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-136bb349-d04c-48f5-97c9-baba3b66316c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=bfea173096cf4b509735ffd535193ea5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0493145
May 20 16:19:49.290565 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:49.295608 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:49.418506 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-c9cf5e4a-9ff0-4784-b8c7-156c59ce9c94 service neutron] 10.222.0.64 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1293793
May 20 16:19:49.554776 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-64349a5a-86e2-483a-ad61-dd2751c55718 service neutron] 10.222.0.64 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1302259
May 20 16:19:49.644796 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:49.961865 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['51bfa597-72ba-47c7-b8e7-ebd34fd1b827'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:19:50.061634 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f338f62-c1e7-445a-a45d-e7c4dda12852 req-360e6a60-489b-4029-b28c-1ed75b8d2e01 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:50.063078 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1f338f62-c1e7-445a-a45d-e7c4dda12852 req-360e6a60-489b-4029-b28c-1ed75b8d2e01 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1116779
May 20 16:19:50.071850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af2f5f17-a724-4502-80ba-a02c02ccdab2 req-098bd5b6-c194-45ee-aa46-2eb797f06f1e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:50.073443 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-af2f5f17-a724-4502-80ba-a02c02ccdab2 req-098bd5b6-c194-45ee-aa46-2eb797f06f1e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 944 time: 0.1654210
May 20 16:19:50.147751 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1f338f62-c1e7-445a-a45d-e7c4dda12852 req-1493c0b8-f747-4bd5-b5a3-e57b71a9dacf tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0730214
May 20 16:19:50.154534 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-af2f5f17-a724-4502-80ba-a02c02ccdab2 req-2944b532-b77d-4dd5-a5fa-53d5b6adf9a2 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0662065
May 20 16:19:50.245573 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e2222973-afb5-4743-8bec-7f3a9597a922 req-c8f63d8c-57a5-4bf2-9839-e53eb44adfa8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 210 time: 0.0436299
May 20 16:19:50.375130 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 32966) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:50.392913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:50.407667 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:50.411936 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Usage tracker for resource:security_group_rule and tenant:19ff807ae7dc4eb79d50cbb17475a126 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:50.416173 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:50.422379 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:50.512837 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:50.598359 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:50.607069 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:50.647132 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=19ff807ae7dc4eb79d50cbb17475a126&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2708621
May 20 16:19:50.649330 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3495ce1-9278-4c77-ba89-c08d18360e29,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:50.650926 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 32972) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:50.660904 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:50.710950 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:50.736566 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:50.935724 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:50.939512 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d78712bd-84de-409c-be61-71c598992794 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:50.949782 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 32988) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:50.956528 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3495ce1-9278-4c77-ba89-c08d18360e29,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:50.959267 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:50.970179 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:50.973680 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/c3495ce1-9278-4c77-ba89-c08d18360e29 HTTP/1.1" status: 204  len: 168 time: 0.3191974
May 20 16:19:51.095670 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_v2 [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Deleting subnet 1d53e6da-5a0a-4b0a-95e9-3ce09d811a16 {{(pid=92422) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:19:51.098763 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.148815 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6219245'] for subnet, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.217504 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.402119 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.422042 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052dfdd8-9c26-45f0-a9a0-cd7776bc09a6 req-fc3a9048-b366-4c15-ace9-07b0653f55f8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:51.423477 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-052dfdd8-9c26-45f0-a9a0-cd7776bc09a6 req-fc3a9048-b366-4c15-ace9-07b0653f55f8 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1503479
May 20 16:19:51.431953 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6843f200-0255-48b3-bac7-cc3ab229d4ed req-adc23c83-edad-494b-8543-876306e5bcf2 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:51.433386 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6843f200-0255-48b3-bac7-cc3ab229d4ed req-adc23c83-edad-494b-8543-876306e5bcf2 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 944 time: 0.1247201
May 20 16:19:51.569062 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-052dfdd8-9c26-45f0-a9a0-cd7776bc09a6 req-e40c3e9c-2e30-495b-ab5c-065b6908295b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1347010
May 20 16:19:51.577124 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6843f200-0255-48b3-bac7-cc3ab229d4ed req-01995dff-e232-42e3-acec-05e6fe1b6b24 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1252184
May 20 16:19:51.631442 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6358801', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6223409'] for subnet, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.638906 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:51.686149 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1d53e6da-5a0a-4b0a-95e9-3ce09d811a16,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:51.693649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:51.694866 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.706819 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] 10.222.0.64 "DELETE /v2.0/subnets/1d53e6da-5a0a-4b0a-95e9-3ce09d811a16 HTTP/1.1" status: 204  len: 168 time: 0.7558510
May 20 16:19:51.709306 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33008) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:51.746092 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-87909d45-2cc7-4089-9fbd-4ac2384c8e60 req-aba0bf63-584a-4e1d-9567-7cd0fdbe4431 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 210 time: 0.0486050
May 20 16:19:51.826633 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.951337 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:51.968302 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe711549430>,) {'filters': {'network_id': ['853a1012-183a-434d-8802-c341517512ed']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:19:51.981279 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711549430>, '1bdeb0b5-b2b5-415a-827c-6b7f1e164ede') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:19:51.981585 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711549430>, '1bdeb0b5-b2b5-415a-827c-6b7f1e164ede') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:19:51.995231 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.014246 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.021527 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Releasing vlan 613 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:19:52.021917 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:19:52.036283 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:19:52.247324 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.260268 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e0be6875-6c75-4946-a8fe-145fe31b82e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:52.284154 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.290788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Pushing event deleted for resources: {'Network': ['ID=853a1012-183a-434d-8802-c341517512ed,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:52.294018 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:52.295540 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d7d12c48-1dcc-4a30-9ef4-575f96a00a1a admin admin] 10.222.0.64 "DELETE /v2.0/networks/853a1012-183a-434d-8802-c341517512ed HTTP/1.1" status: 204  len: 168 time: 0.5850711
May 20 16:19:52.298344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33024) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:52.357781 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_v2 [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Deleting subnet e1e82f44-8ecf-40bd-915b-dbec42cc9de9 {{(pid=92422) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:19:52.361043 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.411465 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6219245'] for subnet, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.469562 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.735975 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:19:52.845536 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526554a5-5f6c-4f5c-9ac7-082aeb2f064f req-9b6a9cc3-bc9b-4b50-ad04-0111d692f8aa tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:52.847125 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-526554a5-5f6c-4f5c-9ac7-082aeb2f064f req-9b6a9cc3-bc9b-4b50-ad04-0111d692f8aa tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 944 time: 0.1162012
May 20 16:19:52.854688 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a03f9e8-c956-4b17-acf7-057bf286e2d6 req-27f23e6b-253d-4402-b1d6-c254b76f375b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:52.856099 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3a03f9e8-c956-4b17-acf7-057bf286e2d6 req-27f23e6b-253d-4402-b1d6-c254b76f375b tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1647036
May 20 16:19:52.910727 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6358801', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6223409'] for subnet, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.915924 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4cb35a90-5c56-40c2-a23d-148feb8650f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:52.926294 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-526554a5-5f6c-4f5c-9ac7-082aeb2f064f req-fcc64b22-2ff9-43d0-8064-2f86623d705c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0690777
May 20 16:19:52.930653 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3a03f9e8-c956-4b17-acf7-057bf286e2d6 req-3c92d58a-ce9b-497d-b9cb-25c29d14a469 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0601480
May 20 16:19:52.952739 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e1e82f44-8ecf-40bd-915b-dbec42cc9de9,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:52.956938 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:52.966893 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33044) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:52.967034 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] 10.222.0.64 "DELETE /v2.0/subnets/e1e82f44-8ecf-40bd-915b-dbec42cc9de9 HTTP/1.1" status: 204  len: 168 time: 0.6677277
May 20 16:19:52.968114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-cd9204cc-1e37-4572-b6dd-65829b6395db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:52.970007 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:19:52.975707 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:19:52.976277 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.148763 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.208722 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.215070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4dfbd4c1-e0d7-4b9c-8cc2-8cb1fc441e86 req-e1520855-d375-47fb-8b3a-d14355014099 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 210 time: 0.1076031
May 20 16:19:53.216110 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7902b3ab-c575-46b6-853a-8705c994ff11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:19:53.234933 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:19:53.296161 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7902b3ab-c575-46b6-853a-8705c994ff11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827', 'code': 200}
May 20 16:19:53.319284 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-17a16aa2-bdfa-4132-91c3-09644e4fee90 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:53.320845 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-17a16aa2-bdfa-4132-91c3-09644e4fee90 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "GET /v2.0/networks?id=ff8e44fb-6ead-46de-8521-764b50418880 HTTP/1.1" status: 200  len: 808 time: 0.2335215
May 20 16:19:53.335811 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Request body: {'port': {'device_id': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880', 'admin_state_up': True, 'tenant_id': 'bfea173096cf4b509735ffd535193ea5'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:19:53.435580 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.438136 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:53.502129 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.518160 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe7126a1d90>,) {'filters': {'network_id': ['c878f4fe-30d7-4d89-879e-939fcf7b6554']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:19:53.537178 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7126a1d90>, 'a10babc1-2d23-4bf5-83a6-09aee2cd359a') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:19:53.537972 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7126a1d90>, 'a10babc1-2d23-4bf5-83a6-09aee2cd359a') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:19:53.553644 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.561080 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:53.570633 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:53.573301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.580197 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Releasing vlan 621 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:19:53.585774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:53.591460 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Usage tracker for resource:port and tenant:bfea173096cf4b509735ffd535193ea5 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:53.595899 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.596026 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:53.601375 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:19:53.605447 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:19:53.718250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Made reservation on behalf of bfea173096cf4b509735ffd535193ea5 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:19:53.721755 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.850407 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.864998 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:53.871475 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f113f694-c61b-4401-bff8-090d3b7a9441 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:53.914372 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] 10.222.0.64 "DELETE /v2.0/networks/c878f4fe-30d7-4d89-879e-939fcf7b6554 HTTP/1.1" status: 204  len: 168 time: 0.9460247
May 20 16:19:53.923582 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Pushing event deleted for resources: {'Network': ['ID=c878f4fe-30d7-4d89-879e-939fcf7b6554,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:53.929106 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:53.951874 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Allocated IP 172.20.0.14 (ff8e44fb-6ead-46de-8521-764b50418880/119e0a0a-4f75-4580-afee-ce96f3e12878/ac62015d-43b6-486e-8e19-31bdbf3093d8) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:19:53.990270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5ffc2a-4a1d-47e0-85ef-9a3ddb8db3c0 req-d8d8c136-823e-4f17-b0dc-70e969464db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:53.991915 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0b5ffc2a-4a1d-47e0-85ef-9a3ddb8db3c0 req-d8d8c136-823e-4f17-b0dc-70e969464db1 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 1098 time: 0.1800880
May 20 16:19:54.039223 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0b5ffc2a-4a1d-47e0-85ef-9a3ddb8db3c0 req-47430a8d-b01f-4ad2-ac07-241b3b2ce989 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404043
May 20 16:19:54.140215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39665581-3842-4b48-a042-f28b5097ca74 req-81b7640c-949a-4eda-8665-aece5d99b38d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:54.158143 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-39665581-3842-4b48-a042-f28b5097ca74 req-81b7640c-949a-4eda-8665-aece5d99b38d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 945 time: 0.1017034
May 20 16:19:54.189040 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-39665581-3842-4b48-a042-f28b5097ca74 req-54a8bb88-8a73-4861-9129-b78172b81194 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414562
May 20 16:19:54.304913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:54.377138 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc5fcfdd-6cd5-4c36-adc2-e0cfc9b8d42b req-d5ba6730-ff66-468b-8caa-c7d644504b74 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 210 time: 0.0444119
May 20 16:19:54.516248 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:54.522390 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:54.585087 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Network ff8e44fb-6ead-46de-8521-764b50418880 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:19:54.588357 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:19:54.592163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:19:54.631267 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Pushing event updated for resources: {'Port': ['ID=ac62015d-43b6-486e-8e19-31bdbf3093d8,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:54.636103 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:54.650945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33094) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:54.664278 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:54.664882 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:54.700283 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-5bbce51d-6d64-4e3e-a70c-82253220b6b9 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=2d0eeaab3cf644b5833061be9449e13d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0484879
May 20 16:19:54.702825 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33098) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:54.762536 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:54.787480 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:54.819120 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.4872241
May 20 16:19:54.830752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Request body: {'port': {'device_id': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:19:54.942577 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:54.967437 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:54.972870 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-3e967ec4-79af-40d5-b4e2-a64b22d5af00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:54.986321 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57077c75-bfd7-4b14-9636-3e7d8932f3e6,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:54.992888 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:55.004539 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:55.004539 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/57077c75-bfd7-4b14-9636-3e7d8932f3e6 HTTP/1.1" status: 204  len: 168 time: 0.2951334
May 20 16:19:55.299894 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ac62015d-43b6-486e-8e19-31bdbf3093d8 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:19:55.308589 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:55.325602 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Transition to ACTIVE for port object ac62015d-43b6-486e-8e19-31bdbf3093d8 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:19:55.396262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad3c590-b309-45e5-8362-344b8315d48a req-597739e4-12b1-4287-ad96-703f15a44b6e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:55.397743 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bad3c590-b309-45e5-8362-344b8315d48a req-597739e4-12b1-4287-ad96-703f15a44b6e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 945 time: 0.0835013
May 20 16:19:55.447878 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bad3c590-b309-45e5-8362-344b8315d48a req-9c65ad21-8ee1-46b1-bbf0-80ab410c9453 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434549
May 20 16:19:55.465002 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:55.470114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-c3947572-28ab-4653-b8a7-52c63ef7f57f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:55.621384 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7da505-8ad2-4d42-8cb0-ce9c7c03128a req-0c0efdea-0937-45f1-a2e9-2adb822b60ce tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:55.628651 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c7da505-8ad2-4d42-8cb0-ce9c7c03128a req-0c0efdea-0937-45f1-a2e9-2adb822b60ce tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 944 time: 0.1042430
May 20 16:19:55.676426 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c7da505-8ad2-4d42-8cb0-ce9c7c03128a req-ab95f91e-2d81-4774-b0ce-0c5fa0e0cd7b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469401
May 20 16:19:55.792385 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Pushing event updated for resources: {'Port': ['ID=ac62015d-43b6-486e-8e19-31bdbf3093d8,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:55.800753 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.331s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:55.846539 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-64671860-2d33-45ac-99d5-442781e64d4d service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2003815
May 20 16:19:55.847349 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Attempting to bind port ac62015d-43b6-486e-8e19-31bdbf3093d8 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:19:55.847673 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Attempting to bind port ac62015d-43b6-486e-8e19-31bdbf3093d8 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:19:55.847986 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Attempting to bind port ac62015d-43b6-486e-8e19-31bdbf3093d8 on network ff8e44fb-6ead-46de-8521-764b50418880 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:19:55.853637 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Port ac62015d-43b6-486e-8e19-31bdbf3093d8 on network ff8e44fb-6ead-46de-8521-764b50418880 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:19:55.853637 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Attempting to bind port ac62015d-43b6-486e-8e19-31bdbf3093d8 on network ff8e44fb-6ead-46de-8521-764b50418880 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:19:55.859297 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 19, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:19:55.865534 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Checking segment: {'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:19:55.865534 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Bound using segment: {'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:19:55.865534 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Bound port: ac62015d-43b6-486e-8e19-31bdbf3093d8, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:19:55.865534 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:55.986195 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33124) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:56.005835 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] For port ac62015d-43b6-486e-8e19-31bdbf3093d8, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:19:56.023327 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] For port ac62015d-43b6-486e-8e19-31bdbf3093d8, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=ac62015d-43b6-486e-8e19-31bdbf3093d8,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:19:56.034914 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-083e61a3-9011-4c97-9dac-0897c66a4326 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.038246 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-083e61a3-9011-4c97-9dac-0897c66a4326 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 1099 time: 0.1342852
May 20 16:19:56.044167 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33130) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:56.050651 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-ede1b202-7bc2-4b00-bca9-8a2d3aa0a346 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=2f5e810c0dc440c1b9de41e30dd0d19a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0534809
May 20 16:19:56.252064 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:56.257373 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e49dc53e-6aa8-4770-957a-fdef707a096c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:56.357870 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.358556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:56.359861 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] 10.222.0.16 "PUT /v2.0/ports/ac62015d-43b6-486e-8e19-31bdbf3093d8 HTTP/1.1" status: 200  len: 1094 time: 1.5332434
May 20 16:19:56.360350 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'tag': 'ac62015d-43b6-486e-8e19-31bdbf3093d8'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:19:56.373299 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:56.381732 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-1a35587a-1c80-4618-8e78-6ef9594c514c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.383215 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-1a35587a-1c80-4618-8e78-6ef9594c514c service neutron] 10.222.0.16 "GET /v2.0/networks?id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 200  len: 920 time: 0.3236625
May 20 16:19:56.390818 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Pushing event updated for resources: {'Port': ['ID=ac62015d-43b6-486e-8e19-31bdbf3093d8,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:56.447387 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:56.460469 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'tag': 'ac62015d-43b6-486e-8e19-31bdbf3093d8', 'status': 'completed', 'code': 200}
May 20 16:19:56.505892 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-404cc073-c796-486b-a9e9-dd98a83e590e service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=12e95041-05fa-4910-ada4-e349ed594896 HTTP/1.1" status: 200  len: 217 time: 0.1089432
May 20 16:19:56.519588 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:56.630851 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-9d9dbe73-bf23-426e-a721-461d0bb758a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.632308 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-9d9dbe73-bf23-426e-a721-461d0bb758a7 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 200  len: 859 time: 0.0999148
May 20 16:19:56.643134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9862885-c1c3-429e-9e16-b391928e9e86 req-10e4f265-d180-42a3-bb6a-b5e3ab24a815 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.644511 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e9862885-c1c3-429e-9e16-b391928e9e86 req-10e4f265-d180-42a3-bb6a-b5e3ab24a815 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=bfea173096cf4b509735ffd535193ea5&device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 1097 time: 0.1833212
May 20 16:19:56.667737 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9507ae4f-befb-4a16-bf3d-a5eb7304e0a3 req-9515b20e-81a3-4c2b-b7be-749290517c4e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.669313 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9507ae4f-befb-4a16-bf3d-a5eb7304e0a3 req-9515b20e-81a3-4c2b-b7be-749290517c4e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 945 time: 0.0933914
May 20 16:19:56.721444 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-4d23c37f-f2bb-4750-96c5-a46554600068 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0682399
May 20 16:19:56.723796 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9507ae4f-befb-4a16-bf3d-a5eb7304e0a3 req-ff9ce552-243d-4b17-80bc-30e4405528ac tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0474935
May 20 16:19:56.821662 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:56.829606 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-09316c2b-6c1c-4a1e-8940-574285be7de4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:56.888947 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-372998d7-4196-4d76-8310-865e03d2a466 req-64dddcee-5e61-4da4-9102-a9762b297b4c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.890550 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-372998d7-4196-4d76-8310-865e03d2a466 req-64dddcee-5e61-4da4-9102-a9762b297b4c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 944 time: 0.0902965
May 20 16:19:56.904556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff4b7e86-e0bb-4062-9c07-9432b173175f,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:56.911136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:56.929752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:56.930920 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/ff4b7e86-e0bb-4062-9c07-9432b173175f HTTP/1.1" status: 204  len: 168 time: 0.8854027
May 20 16:19:56.954618 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9862885-c1c3-429e-9e16-b391928e9e86 req-42a9f064-0b54-4a41-96bb-deaced652333 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:56.956208 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e9862885-c1c3-429e-9e16-b391928e9e86 req-42a9f064-0b54-4a41-96bb-deaced652333 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=bfea173096cf4b509735ffd535193ea5&shared=False HTTP/1.1" status: 200  len: 909 time: 0.3019850
May 20 16:19:56.971888 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-372998d7-4196-4d76-8310-865e03d2a466 req-42aecb5d-2ee1-4ede-bbbc-d6be8a0c4dbe tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0754976
May 20 16:19:57.021123 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-57abdaf3-f0c8-4461-92ff-8adf2cd904b3 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2894039
May 20 16:19:57.213611 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9862885-c1c3-429e-9e16-b391928e9e86 req-44b7d7d5-1e78-4a14-9355-37bde685f122 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:57.215086 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e9862885-c1c3-429e-9e16-b391928e9e86 req-44b7d7d5-1e78-4a14-9355-37bde685f122 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2516706
May 20 16:19:57.241453 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-0bcec6d0-01fc-4fd6-b207-9632af8efad5 req-b7065aeb-8678-4c2b-8a9c-984d07e11a55 service neutron] 10.222.0.16 "GET /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2122624
May 20 16:19:57.323869 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-93bb2cf9-b01e-45ab-bb29-142bd41b8bc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:57.325350 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-93bb2cf9-b01e-45ab-bb29-142bd41b8bc3 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=bfea173096cf4b509735ffd535193ea5&device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 1097 time: 0.0721257
May 20 16:19:57.396561 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-8831311a-fd0c-43c9-b94c-a0bb308d51b0 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=ac62015d-43b6-486e-8e19-31bdbf3093d8 HTTP/1.1" status: 200  len: 217 time: 0.0640895
May 20 16:19:57.464853 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-984d992f-e1eb-4cc7-8098-479b5d7a2f41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:57.464853 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-984d992f-e1eb-4cc7-8098-479b5d7a2f41 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=119e0a0a-4f75-4580-afee-ce96f3e12878 HTTP/1.1" status: 200  len: 848 time: 0.0588987
May 20 16:19:57.511831 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-fba28e06-e06d-4fe5-9ac8-75965edc9c99 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=ff8e44fb-6ead-46de-8521-764b50418880&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0414426
May 20 16:19:57.650153 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-27c92514-aa37-4029-8039-9fe0d7fef8f1 service neutron] 10.222.0.16 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1316378
May 20 16:19:57.871667 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a373bccd-415d-4e34-af60-54f6aa2771ca req-184a2d2e-7e78-4aa5-ad98-d1eac8b49b93 service neutron] 10.222.0.16 "GET /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2098832
May 20 16:19:58.169567 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72821d5e-a55e-4934-b340-977142e6658f req-f8f90cb0-e498-48bd-85f2-2d1f75409f38 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:58.171060 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-72821d5e-a55e-4934-b340-977142e6658f req-f8f90cb0-e498-48bd-85f2-2d1f75409f38 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 944 time: 0.0903897
May 20 16:19:58.217949 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-72821d5e-a55e-4934-b340-977142e6658f req-7d06fc52-86a5-428b-9a48-6b876ee8a38b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411532
May 20 16:19:58.621298 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:58.875993 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33200) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:59.005744 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:59.020724 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:19:59.024773 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Usage tracker for resource:security_group_rule and tenant:63e13cb4e9d94520b48376c286cd385c is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:19:59.028550 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:19:59.034288 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:19:59.125267 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:59.307018 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:59.317159 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5ec799ef-c4da-4be7-bf4a-6c522278aed8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:59.356453 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2726b6f3-c2b8-4df0-826c-e6cb4328d8c6,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:59.359781 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:59.368040 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=63e13cb4e9d94520b48376c286cd385c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4906011
May 20 16:19:59.369924 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33216) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:19:59.417584 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e090b9-bf56-4e97-bf6f-7941cf3f9b60 req-30528133-9aa1-49f2-a858-f55d0d9f6a3a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:19:59.419049 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e6e090b9-bf56-4e97-bf6f-7941cf3f9b60 req-30528133-9aa1-49f2-a858-f55d0d9f6a3a tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 944 time: 0.0937915
May 20 16:19:59.432525 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:59.461685 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:59.528211 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e6e090b9-bf56-4e97-bf6f-7941cf3f9b60 req-824952a1-8c85-440f-bcf5-c79c5ecde1aa tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1033170
May 20 16:19:59.643867 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:59.649500 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-902a07e9-f377-4713-b6c8-dc6fbc6ba9b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:19:59.662123 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2726b6f3-c2b8-4df0-826c-e6cb4328d8c6,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:19:59.664420 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:19:59.668493 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:19:59.670296 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/2726b6f3-c2b8-4df0-826c-e6cb4328d8c6 HTTP/1.1" status: 204  len: 168 time: 0.2989798
May 20 16:19:59.961716 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:20:00.631496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33246) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:00.649368 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:00.668239 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:00.673051 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Usage tracker for resource:security_group_rule and tenant:8e5fa0536333406c9e3cb6260b8dbf8b is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:00.676547 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:00.682957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:00.726478 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49eae44-165c-4beb-976b-054ac5d65edc req-63523dd9-a8dc-49b1-ad11-ee68c485b947 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:00.727988 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d49eae44-165c-4beb-976b-054ac5d65edc req-63523dd9-a8dc-49b1-ad11-ee68c485b947 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 944 time: 0.0896993
May 20 16:20:00.764594 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device ac62015d-43b6-486e-8e19-31bdbf3093d8 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:20:00.768730 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:00.780974 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d49eae44-165c-4beb-976b-054ac5d65edc req-5511e9d9-b274-4c29-8165-3cee0168f24d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457728
May 20 16:20:00.872557 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:00.881193 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0b173a6e-5df8-4936-aae6-2ad051ec80c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:00.911909 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port ac62015d-43b6-486e-8e19-31bdbf3093d8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=ac62015d-43b6-486e-8e19-31bdbf3093d8,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:00.923475 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d82c67dd-ad65-4bb0-b894-ba8073fc8991,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:00.925076 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': 'ac62015d-43b6-486e-8e19-31bdbf3093d8', 'network_id': 'ff8e44fb-6ead-46de-8521-764b50418880', 'port_id': 'ac62015d-43b6-486e-8e19-31bdbf3093d8', 'mac_address': 'fa:16:3e:ec:ef:6a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 643, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '119e0a0a-4f75-4580-afee-ce96f3e12878', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:20:00.927828 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=8e5fa0536333406c9e3cb6260b8dbf8b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2951617
May 20 16:20:00.928791 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:00.930342 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33254) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:00.987845 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:00.992311 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:01.010569 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ac62015d-43b6-486e-8e19-31bdbf3093d8 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:20:01.042109 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:01.042276 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port ac62015d-43b6-486e-8e19-31bdbf3093d8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=ac62015d-43b6-486e-8e19-31bdbf3093d8,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:01.209547 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:01.209769 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:01.211445 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:01.214815 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1a1ca4d7-0a35-4748-a301-4e9e4b9db883 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:01.228301 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d82c67dd-ad65-4bb0-b894-ba8073fc8991,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:01.230556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:01.234157 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d82c67dd-ad65-4bb0-b894-ba8073fc8991 HTTP/1.1" status: 204  len: 168 time: 0.3004479
May 20 16:20:01.234157 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:01.288030 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=ac62015d-43b6-486e-8e19-31bdbf3093d8,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:01.291884 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:01.979374 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f22cb0-9ce9-424f-804f-afb040e6d8a8 req-494fc8c8-7246-4be3-8a8b-80f66592de33 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:01.980836 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-42f22cb0-9ce9-424f-804f-afb040e6d8a8 req-494fc8c8-7246-4be3-8a8b-80f66592de33 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 945 time: 0.0816362
May 20 16:20:02.025758 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-42f22cb0-9ce9-424f-804f-afb040e6d8a8 req-7e292b0c-decc-45f4-b070-e1b8985ecd24 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391209
May 20 16:20:03.341187 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33326) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:03.365513 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a3c43a-fdef-49d2-9665-c93f692b9a04 req-38ca07eb-9cf9-48a3-b14d-f3ad3f97fab2 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:03.367017 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-54a3c43a-fdef-49d2-9665-c93f692b9a04 req-38ca07eb-9cf9-48a3-b14d-f3ad3f97fab2 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 945 time: 0.0891194
May 20 16:20:03.414325 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-54a3c43a-fdef-49d2-9665-c93f692b9a04 req-3ffe7092-37b5-42db-991c-3ebb810393a7 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407577
May 20 16:20:03.461316 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:03.474881 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:03.478679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Usage tracker for resource:security_group_rule and tenant:5da0ef7a61c2493292f03c9724ed3daa is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:03.481430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:03.486914 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:03.564367 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:03.655259 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:03.664107 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6efa3cae-b86c-49e0-8ac2-600a623305b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:03.705621 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=5da0ef7a61c2493292f03c9724ed3daa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3632185
May 20 16:20:03.711335 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=365141df-588d-467e-8c8f-89e7e50226ab,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:03.711610 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33336) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:03.727051 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:03.768210 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:03.793653 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:03.935376 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:03.939117 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-61d84080-b390-4e9f-aacc-2df2ac22d5da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:03.950137 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=365141df-588d-467e-8c8f-89e7e50226ab,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:03.953484 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:03.956629 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:03.957722 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/365141df-588d-467e-8c8f-89e7e50226ab HTTP/1.1" status: 204  len: 168 time: 0.2484767
May 20 16:20:04.613077 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1851d2ba-ca49-4401-8186-75e47bf0ddb2 req-a1744c70-1d14-4db5-a9e8-033a0d195244 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:04.614818 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1851d2ba-ca49-4401-8186-75e47bf0ddb2 req-a1744c70-1d14-4db5-a9e8-033a0d195244 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 945 time: 0.0929954
May 20 16:20:04.659609 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1851d2ba-ca49-4401-8186-75e47bf0ddb2 req-2aed4dc0-51b4-4372-85d5-1736019540d4 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390737
May 20 16:20:05.098376 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33374) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:05.202221 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1006810869-network', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:05.206906 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:05.210873 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Usage tracker for resource:network and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:05.214313 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:05.220650 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:05.321154 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Made reservation on behalf of b05498ab061b462e9f28e7d5e6bff55e for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:20:05.324067 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.337244 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.352321 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:05.356225 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:05.359074 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:05.365358 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:05.445976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.510360 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.513415 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5a6ffd4c-8b2a-48de-b856-4f99b2924df6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:05.546237 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] vlan segment allocate from pool success with {'vlan_id': 629, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:20:05.551602 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2a07d3f-5619-4575-b406-cbf01e374aa2,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:05.555133 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:05.558833 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.559342 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Added segment 855ceff0-a862-4f90-88cc-63bc7047c2ce of type vlan for network 39834042-f759-400b-9bc0-eb7c7abdd5c0
May 20 16:20:05.586237 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.710299 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.711774 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:05.712384 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:05.717670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a074c46b-4b36-4110-abe5-1eb6cdb26b4f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:05.857884 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Pushing event updated for resources: {'Network': ['ID=39834042-f759-400b-9bc0-eb7c7abdd5c0,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:05.866398 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:05.868864 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:20:05.871456 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.7720010
May 20 16:20:05.874897 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33386) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:05.881411 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Request body: {'subnet': {'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1006810869-subnet', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:05.899743 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:05.904136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Usage tracker for resource:subnet and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:05.907244 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:05.909641 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a172f5bf-5df5-45df-8222-f1f8d3ca1ba2 req-1e237ccc-9dc1-40e8-bb93-386c9da5f9ae tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:05.911177 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a172f5bf-5df5-45df-8222-f1f8d3ca1ba2 req-1e237ccc-9dc1-40e8-bb93-386c9da5f9ae tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 945 time: 0.0973439
May 20 16:20:05.913788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:05.964858 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a172f5bf-5df5-45df-8222-f1f8d3ca1ba2 req-d13d854a-f271-4e33-aded-f1ff040a5a55 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0465114
May 20 16:20:06.035502 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Made reservation on behalf of b05498ab061b462e9f28e7d5e6bff55e for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:20:06.037807 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6223402'] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:06.341859 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['ac62015d-43b6-486e-8e19-31bdbf3093d8'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:06.487706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6358878', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6223416'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:06.492874 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-983741ae-b088-4c65-89e7-406049b1426c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:06.568046 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Pushing event updated for resources: {'Subnet': ['ID=b5688f1d-b45f-4391-b845-213d900ae645,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:06.572035 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:06.576174 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Checking segment: {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:06.576527 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Network hostable DHCP agents. Network: 39834042-f759-400b-9bc0-eb7c7abdd5c0, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:20:06.743989 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:20:06.854950 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 39834042-f759-400b-9bc0-eb7c7abdd5c0) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:06.863873 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:06.864728 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:06.865025 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f2ec1ab-73a4-4773-8c5e-2f4afed39c79 None None] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:20:07.008393 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.1313522
May 20 16:20:07.013422 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33402) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:07.018801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:07.026641 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:07.030971 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Usage tracker for resource:router and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:07.035159 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:07.043394 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:07.093351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-39834042-f759-400b-9bc0-eb7c7abdd5c0', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:20:07.095162 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.414383 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1291dc7-ab0c-4182-8a32-7efc6a309be2 req-af1ef571-7338-4eb1-8eda-f758b17c940f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:07.414383 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a1291dc7-ab0c-4182-8a32-7efc6a309be2 req-af1ef571-7338-4eb1-8eda-f758b17c940f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 945 time: 0.0880954
May 20 16:20:07.414383 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a1291dc7-ab0c-4182-8a32-7efc6a309be2 req-0d527c60-e7da-4e73-90ba-13972308b93f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427139
May 20 16:20:07.415005 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Allocated IP 172.20.0.2 (39834042-f759-400b-9bc0-eb7c7abdd5c0/b5688f1d-b45f-4391-b845-213d900ae645/9888eb71-0361-4b2a-9aef-ba7cfdec74ca) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:20:07.472498 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.473675 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.492368 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.524893 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.534721 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Transition to ACTIVE for port object 9888eb71-0361-4b2a-9aef-ba7cfdec74ca will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:07.553989 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Transition to ACTIVE for port object 9888eb71-0361-4b2a-9aef-ba7cfdec74ca will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:07.685057 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.689725 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:07.750161 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:07.753096 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:07.756991 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:20:07.797702 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Pushing event updated for resources: {'Port': ['ID=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:07.807736 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:07.867858 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Attempting to bind port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:20:07.868247 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Attempting to bind port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:20:07.868618 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Attempting to bind port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca on network 39834042-f759-400b-9bc0-eb7c7abdd5c0 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:20:07.874273 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:20:07.874699 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Checking segment: {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:07.875107 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.875590 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Bound using segment: {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:20:07.876038 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Bound port: 9888eb71-0361-4b2a-9aef-ba7cfdec74ca, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:20:07.876420 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.932089 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:07.964295 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] For port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:20:07.967214 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] For port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:20:08.250096 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:08.254701 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:08.331839 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Pushing event updated for resources: {'Port': ['ID=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:08.335071 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:08.602213 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7099e7eb-7f30-4dff-ae0f-eb8443ffe9e0 req-9e18a12e-c493-46e2-8ec3-19cc289f65d6 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:08.603886 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7099e7eb-7f30-4dff-ae0f-eb8443ffe9e0 req-9e18a12e-c493-46e2-8ec3-19cc289f65d6 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 945 time: 0.1114273
May 20 16:20:08.697929 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7099e7eb-7f30-4dff-ae0f-eb8443ffe9e0 req-cba73ce6-3fa5-45a0-a003-e1c3430cedb9 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0840256
May 20 16:20:08.754240 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:08.786144 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:08.842587 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device ac62015d-43b6-486e-8e19-31bdbf3093d8 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:08.936176 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Allocated IP 172.27.0.60 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/7c049b55-c8f9-4a69-89fd-2154dc8abb00) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:20:09.009788 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port ac62015d-43b6-486e-8e19-31bdbf3093d8 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:09.015052 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port ac62015d-43b6-486e-8e19-31bdbf3093d8 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:09.019382 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.099840 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.171117 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.203686 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac62015d-43b6-486e-8e19-31bdbf3093d8'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:09.215956 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port ac62015d-43b6-486e-8e19-31bdbf3093d8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=ac62015d-43b6-486e-8e19-31bdbf3093d8,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:09.231432 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.234654 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:09.266046 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac62015d-43b6-486e-8e19-31bdbf3093d8', 'code': 200}
May 20 16:20:09.311662 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:09.314612 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:09.318626 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:20:09.324063 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.327110 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:09.354884 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Pushing event updated for resources: {'Port': ['ID=7c049b55-c8f9-4a69-89fd-2154dc8abb00,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:09.359627 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:09.441657 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=ac62015d-43b6-486e-8e19-31bdbf3093d8,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:09.453469 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:09.469573 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f68b71d-6b1e-436f-9e74-08090213b2af None None] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:20:09.563916 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 9888eb71-0361-4b2a-9aef-ba7cfdec74ca up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:09.610730 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9d7a2515-596c-48ea-8c6d-3409a14fceec None None] Provisioning for port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:09.829798 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:09.837036 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:09.840042 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.963360 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.974674 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:09.975902 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ca12c4-0d76-4254-ae67-de727f7ef540 req-48bf25eb-1aa3-40c2-99eb-882a86490e7b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:09.986648 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-93ca12c4-0d76-4254-ae67-de727f7ef540 req-48bf25eb-1aa3-40c2-99eb-882a86490e7b tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.1178942
May 20 16:20:10.037494 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:10.045318 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-93ca12c4-0d76-4254-ae67-de727f7ef540 req-45a6bb58-4733-4684-839f-e71f9cee8bc9 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0574524
May 20 16:20:10.065181 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-85e4e781-dbad-40cf-a05a-808bf9b49f71 None None] Provisioning complete for port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:10.065629 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-85e4e781-dbad-40cf-a05a-808bf9b49f71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:10.119553 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:10.122710 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:10.248713 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:10.252084 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:10.416861 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:10.699216 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Router b2d11483-140f-49b3-9fa7-56159859e29c is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92422) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:20:10.878082 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:20:10.887780 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Sync routers for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:20:10.897710 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:10.898319 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712b84a90>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:19:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:10.980975 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:10.982246 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 3.9677536
May 20 16:20:10.985027 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33476) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:11.069446 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:11.245490 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6800c1f-e2e3-48fa-9398-98aff3e848f5 req-fbe3dd6f-23b1-42e7-be2e-74cbe8621bd4 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:11.247916 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b6800c1f-e2e3-48fa-9398-98aff3e848f5 req-fbe3dd6f-23b1-42e7-be2e-74cbe8621bd4 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.1002624
May 20 16:20:11.305355 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b6800c1f-e2e3-48fa-9398-98aff3e848f5 req-63e39499-b99f-4f21-807f-eec15195fdb8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0500453
May 20 16:20:11.399344 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712b84a90>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:09Z', 'revision_number': 3, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:11.403626 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Checking router: b2d11483-140f-49b3-9fa7-56159859e29c for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:20:11.403970 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Updating router b2d11483-140f-49b3-9fa7-56159859e29c port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:20:11.404940 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 9888eb71-0361-4b2a-9aef-ba7cfdec74ca up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:11.457447 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:11.478431 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:11.478803 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:11.686806 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:11.784132 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:11.795686 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Transition to ACTIVE for port object 7c049b55-c8f9-4a69-89fd-2154dc8abb00 will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:11.894187 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:11.895109 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:11.895976 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Allocated IP 172.20.0.1 (39834042-f759-400b-9bc0-eb7c7abdd5c0/b5688f1d-b45f-4391-b845-213d900ae645/127ab9e0-c76f-4414-a97d-c9566d01d190) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:20:12.004826 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Attempting to bind port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:20:12.005296 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Attempting to bind port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:20:12.005595 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Attempting to bind port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:20:12.011929 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Pushing event updated for resources: {'Port': ['ID=7c049b55-c8f9-4a69-89fd-2154dc8abb00,revision_number=2']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:12.020665 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.020916 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:12.030303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:20:12.031278 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:12.031278 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.031278 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:20:12.031278 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Bound port: 7c049b55-c8f9-4a69-89fd-2154dc8abb00, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:20:12.031278 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.053648 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:12.101952 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] For port 7c049b55-c8f9-4a69-89fd-2154dc8abb00, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:20:12.105489 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] For port 7c049b55-c8f9-4a69-89fd-2154dc8abb00, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=7c049b55-c8f9-4a69-89fd-2154dc8abb00,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:20:12.138399 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.153503 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Transition to ACTIVE for port object 127ab9e0-c76f-4414-a97d-c9566d01d190 will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:12.201518 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.205517 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-d6ef9bb3-ab3f-4bd8-8c06-4f5deaebd7d5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:12.275285 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.280330 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:12.280665 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-54a5d14a-7cab-448b-b12d-97207cd8cffe service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:12.280947 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712b84a90>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:19:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:12.335169 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Pushing event updated for resources: {'Port': ['ID=7c049b55-c8f9-4a69-89fd-2154dc8abb00,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:12.345799 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:12.350310 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:12.353261 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:12.357704 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:20:12.393926 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Pushing event updated for resources: {'Port': ['ID=127ab9e0-c76f-4414-a97d-c9566d01d190,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:12.411660 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:12.424452 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.483313 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:12.538629 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e5ccba-cb54-4814-95a2-1d1127d42235 req-66243c84-a01f-4732-b316-dc3478f65aa1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:12.540310 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d7e5ccba-cb54-4814-95a2-1d1127d42235 req-66243c84-a01f-4732-b316-dc3478f65aa1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.0842648
May 20 16:20:12.598003 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d7e5ccba-cb54-4814-95a2-1d1127d42235 req-6ed13151-cbe0-4424-8eba-6b5d41546e7e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512886
May 20 16:20:12.620751 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.773210 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712b84a90>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:09Z', 'revision_number': 3, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:12.774914 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-7c14755a-7370-49f2-bea0-798894239d84 None None] Provisioning for port 127ab9e0-c76f-4414-a97d-c9566d01d190 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:12.777060 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98b5dd97-ab58-42cb-85eb-ae13c4259da5 None None] The sync data for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi is: [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:09Z', 'revision_number': 3, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:20:12.785482 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-7c14755a-7370-49f2-bea0-798894239d84 None None] Provisioning complete for port 127ab9e0-c76f-4414-a97d-c9566d01d190 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:12.787527 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7c14755a-7370-49f2-bea0-798894239d84 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.848840 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.854024 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-7c14755a-7370-49f2-bea0-798894239d84 None None] Port 127ab9e0-c76f-4414-a97d-c9566d01d190 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:20:12.918017 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:12.944838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0f9abd4a-1851-45c4-b0c6-62126b4ac106 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:13.041194 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Pushing event updated for resources: {'Port': ['ID=127ab9e0-c76f-4414-a97d-c9566d01d190,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:13.045744 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:13.046658 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:13.194066 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:13.195510 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:13.405894 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Router b2d11483-140f-49b3-9fa7-56159859e29c has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:20:13.444921 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7c049b55-c8f9-4a69-89fd-2154dc8abb00 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:13.521833 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-c0364e87-d615-4653-b779-1aad53a4b213 None None] Provisioning complete for port 127ab9e0-c76f-4414-a97d-c9566d01d190 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:13.522488 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c0364e87-d615-4653-b779-1aad53a4b213 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:13.596332 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-c0364e87-d615-4653-b779-1aad53a4b213 None None] Port 127ab9e0-c76f-4414-a97d-c9566d01d190 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:20:13.604498 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:20:13.615578 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] 10.222.0.64 "PUT /v2.0/routers/b2d11483-140f-49b3-9fa7-56159859e29c/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6281235
May 20 16:20:13.667426 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:13.673473 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:13.673852 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:13.805222 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:13.816112 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9598c24-026b-4d4f-afec-eae1c142e647 req-1d2698fc-378b-4b90-8526-a9ba651bdd82 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:13.817512 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9598c24-026b-4d4f-afec-eae1c142e647 req-1d2698fc-378b-4b90-8526-a9ba651bdd82 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.1032860
May 20 16:20:13.823000 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 7c049b55-c8f9-4a69-89fd-2154dc8abb00, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=7c049b55-c8f9-4a69-89fd-2154dc8abb00,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:13.865540 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9598c24-026b-4d4f-afec-eae1c142e647 req-6f954639-2131-40f0-9e10-9954fd7ff795 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416908
May 20 16:20:13.923728 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:13.925573 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:14.003069 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=7c049b55-c8f9-4a69-89fd-2154dc8abb00,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:14.007650 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:14.030305 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c751eb-ec0c-4dd6-8efb-7b149c1d3b78 req-e5b75622-2f2e-44d3-b901-986435f5a43d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:14.031924 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d2c751eb-ec0c-4dd6-8efb-7b149c1d3b78 req-e5b75622-2f2e-44d3-b901-986435f5a43d service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 1099 time: 0.0928459
May 20 16:20:14.074432 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d2c751eb-ec0c-4dd6-8efb-7b149c1d3b78 req-49abbb0c-cc5e-48ab-b420-dea331df47eb service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0356839
May 20 16:20:14.430432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Sync routers for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:20:14.439870 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:14.440484 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712469280>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:19:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:14.605471 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33526) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:14.615120 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2072420104-network', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:14.629941 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:14.654617 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Usage tracker for resource:network and tenant:33df6a8593d344c49044f79e9a65e01f is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:14.654617 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:14.654617 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:14.668369 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:14.783984 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Made reservation on behalf of 33df6a8593d344c49044f79e9a65e01f for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:20:14.786532 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:14.799390 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:14.814184 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:14.830770 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Usage tracker for resource:security_group_rule and tenant:33df6a8593d344c49044f79e9a65e01f is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:14.830770 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:14.830770 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:14.910731 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:14.987882 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712469280>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 2, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:14.992263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Checking router: b2d11483-140f-49b3-9fa7-56159859e29c for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:20:14.992770 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Updating router b2d11483-140f-49b3-9fa7-56159859e29c port 127ab9e0-c76f-4414-a97d-c9566d01d190 binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:20:15.049510 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.055539 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0f7875b0-ef24-4d3b-8904-d90d643bd463 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:15.055820 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.068928 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810b3a70-ae2a-4be8-a9b0-7ef5bc5d9e44 req-6f2cab9f-654b-4249-908a-68d168eae0bc tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:15.071413 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-810b3a70-ae2a-4be8-a9b0-7ef5bc5d9e44 req-6f2cab9f-654b-4249-908a-68d168eae0bc tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.0977507
May 20 16:20:15.092251 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=178990bb-0bfb-49a5-bb01-83e3c70cb0ca,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:15.096205 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:15.102528 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] vlan segment allocate from pool success with {'vlan_id': 647, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:20:15.112945 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.113287 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Added segment 5693de47-397e-4e5a-878b-f95a4a1ed194 of type vlan for network 3e35d18a-64e2-4e37-8db1-1c472e3454f2
May 20 16:20:15.126996 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-810b3a70-ae2a-4be8-a9b0-7ef5bc5d9e44 req-8a96f8b8-dadd-4ba2-9ac0-00704c9a3d63 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0497215
May 20 16:20:15.147840 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.355748 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.357054 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:15.357627 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.361076 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d4e9e2bc-3f90-460d-a945-784f29b6849a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:15.444712 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7c049b55-c8f9-4a69-89fd-2154dc8abb00 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:15.484642 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Pushing event updated for resources: {'Network': ['ID=3e35d18a-64e2-4e37-8db1-1c472e3454f2,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:15.487532 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:15.504518 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.8965816
May 20 16:20:15.505022 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:20:15.507312 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33542) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:15.512823 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Request body: {'subnet': {'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2072420104-subnet', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:15.517728 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:15.521522 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Usage tracker for resource:subnet and tenant:33df6a8593d344c49044f79e9a65e01f is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:15.524474 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:15.530873 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:15.629796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Made reservation on behalf of 33df6a8593d344c49044f79e9a65e01f for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:20:15.634205 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6223402'] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.706475 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.781100 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:15.781470 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.811135 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Transition to ACTIVE for port object 127ab9e0-c76f-4414-a97d-c9566d01d190 will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:15.938621 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:15.949388 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:15.991836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3384ef04-925d-44c1-ac60-b8453c14e5fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:16.167884 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Pushing event updated for resources: {'Port': ['ID=127ab9e0-c76f-4414-a97d-c9566d01d190,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:16.186394 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.186760 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.187051 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.187405 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.187731 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.188055 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.188379 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.188751 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.189031 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.189351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.189669 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.189979 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:16.201581 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:16.205667 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Attempting to bind port 127ab9e0-c76f-4414-a97d-c9566d01d190 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:20:16.206046 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Attempting to bind port 127ab9e0-c76f-4414-a97d-c9566d01d190 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:20:16.206411 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Attempting to bind port 127ab9e0-c76f-4414-a97d-c9566d01d190 on network 39834042-f759-400b-9bc0-eb7c7abdd5c0 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:20:16.211957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:20:16.212337 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Checking segment: {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:16.213261 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:16.213743 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Bound using segment: {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:20:16.214151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Bound port: 127ab9e0-c76f-4414-a97d-c9566d01d190, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:20:16.214527 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:16.374174 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d8a387-db7a-437e-8d3e-74494834907b req-aaa16bce-0d31-4c3b-a58f-be1f60acd766 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:16.377660 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-51d8a387-db7a-437e-8d3e-74494834907b req-aaa16bce-0d31-4c3b-a58f-be1f60acd766 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.1313291
May 20 16:20:16.386351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] For port 127ab9e0-c76f-4414-a97d-c9566d01d190, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:20:16.391363 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] For port 127ab9e0-c76f-4414-a97d-c9566d01d190, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=127ab9e0-c76f-4414-a97d-c9566d01d190,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:20:16.446006 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-51d8a387-db7a-437e-8d3e-74494834907b req-f286d5b6-8cc5-4c20-a171-558ff90000c1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0622654
May 20 16:20:16.483401 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6358878', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6223416'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:16.484428 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:16.488778 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-bca37023-c7e9-49b8-a6ec-8700cb05832f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:16.496158 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:16.578601 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bb854cba-1e3d-40b4-a869-9a7d16f7d6a9,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:16.583158 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:16.591527 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Checking segment: {'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:16.591890 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Network hostable DHCP agents. Network: 3e35d18a-64e2-4e37-8db1-1c472e3454f2, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:20:16.598562 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Pushing event updated for resources: {'Port': ['ID=127ab9e0-c76f-4414-a97d-c9566d01d190,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:16.602990 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:16.617123 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:16.617740 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712469280>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:19:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:16.734217 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c00b21-00c1-451c-bc15-64ab0095dee3 req-6cb9b085-70e4-4fc7-ba39-0c70667a0255 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:16.735848 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c9c00b21-00c1-451c-bc15-64ab0095dee3 req-6cb9b085-70e4-4fc7-ba39-0c70667a0255 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1585920
May 20 16:20:16.777855 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:20:16.788448 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c9c00b21-00c1-451c-bc15-64ab0095dee3 req-461e66bc-65b9-4c75-8829-7fd25959dee0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454667
May 20 16:20:16.814675 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:16.869910 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 3e35d18a-64e2-4e37-8db1-1c472e3454f2) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:16.881281 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:16.881688 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7017e67c-afe6-435f-919f-ad45719c6bc9 None None] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:20:16.882100 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.021844 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-800975c3-531e-4ac1-99a2-d2315588e339 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.5134511
May 20 16:20:17.024510 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33572) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:17.031107 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:17.037737 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:17.044463 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Usage tracker for resource:router and tenant:33df6a8593d344c49044f79e9a65e01f is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:17.047565 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:17.052893 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33576) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:17.055839 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:17.135781 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.139013 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.154733 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.183229 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.199622 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:17.203638 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Usage tracker for resource:security_group_rule and tenant:78dde8f3715249709c5b195dd7127870 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:17.206467 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:17.215646 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:17.300350 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.330375 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-3e35d18a-64e2-4e37-8db1-1c472e3454f2', 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'fixed_ips': [{'subnet_id': 'bb854cba-1e3d-40b4-a869-9a7d16f7d6a9'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:20:17.331240 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.361086 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.370816 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:17.392757 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712469280>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:16Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:17.402114 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d89b938f-dfc1-4ef5-9a0b-8ebc3ee3a75e None None] The sync data for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi is: [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:16Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:20:17.416500 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=78dde8f3715249709c5b195dd7127870&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3594017
May 20 16:20:17.416500 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37723699-2de0-4409-bcb7-53066f6d1753,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:17.428170 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:17.431284 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33582) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:17.541538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.565661 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Allocated IP 172.20.0.2 (3e35d18a-64e2-4e37-8db1-1c472e3454f2/bb854cba-1e3d-40b4-a869-9a7d16f7d6a9/ad2f35e3-ad29-49c3-aa78-af3083c41efb) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:20:17.586239 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.685195 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.729110 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.732359 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-80384b56-b3ef-4f79-8ee0-e8b9fdb76741 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:17.745976 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37723699-2de0-4409-bcb7-53066f6d1753,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:17.749091 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:17.750091 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.751513 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/37723699-2de0-4409-bcb7-53066f6d1753 HTTP/1.1" status: 204  len: 168 time: 0.3218431
May 20 16:20:17.924562 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:17.947508 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Transition to ACTIVE for port object ad2f35e3-ad29-49c3-aa78-af3083c41efb will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:17.956163 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87fee1d0-c189-4f9d-9681-d55bc0a8706a req-d6ba9be7-f74e-4149-82ec-b55293101f84 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:17.958066 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-87fee1d0-c189-4f9d-9681-d55bc0a8706a req-d6ba9be7-f74e-4149-82ec-b55293101f84 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.2866576
May 20 16:20:17.974348 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Transition to ACTIVE for port object ad2f35e3-ad29-49c3-aa78-af3083c41efb will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:18.046619 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-87fee1d0-c189-4f9d-9681-d55bc0a8706a req-a373a44f-9b82-4115-8477-a765a29e942c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0585909
May 20 16:20:18.199206 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.203925 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:18.278290 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:18.283669 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:18.287351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:20:18.329143 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.356819 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Pushing event updated for resources: {'Port': ['ID=ad2f35e3-ad29-49c3-aa78-af3083c41efb,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:18.367608 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.368562 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:18.422722 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b83a0a2e-c0fc-4c27-8219-a0e5ae842025 req-30b575e7-a41a-48ab-9f03-f5f77c05af97 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:18.424521 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b83a0a2e-c0fc-4c27-8219-a0e5ae842025 req-30b575e7-a41a-48ab-9f03-f5f77c05af97 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.2563012
May 20 16:20:18.442760 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Attempting to bind port ad2f35e3-ad29-49c3-aa78-af3083c41efb on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:20:18.443054 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Attempting to bind port ad2f35e3-ad29-49c3-aa78-af3083c41efb by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:20:18.443553 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Attempting to bind port ad2f35e3-ad29-49c3-aa78-af3083c41efb on network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:20:18.450636 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:20:18.452092 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Checking segment: {'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:18.452092 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.453051 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Bound using segment: {'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:20:18.453681 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Bound port: ad2f35e3-ad29-49c3-aa78-af3083c41efb, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:20:18.454068 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.500122 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b83a0a2e-c0fc-4c27-8219-a0e5ae842025 req-09a13773-6921-4554-ba0f-609529b26214 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0683389
May 20 16:20:18.574511 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.583922 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Allocated IP 172.27.0.230 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/2d91e003-e7a9-4c22-9a99-1564da9f0717) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:20:18.626659 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] For port ad2f35e3-ad29-49c3-aa78-af3083c41efb, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:20:18.631149 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] For port ad2f35e3-ad29-49c3-aa78-af3083c41efb, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ad2f35e3-ad29-49c3-aa78-af3083c41efb,segment=NetworkSegment(5693de47-397e-4e5a-878b-f95a4a1ed194),segment_id=5693de47-397e-4e5a-878b-f95a4a1ed194)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:20:18.689178 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-95a6eca2-42cb-4a2b-82ae-7e8abbf95487 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.717999 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.722678 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:18.761585 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.818167 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Pushing event updated for resources: {'Port': ['ID=ad2f35e3-ad29-49c3-aa78-af3083c41efb,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:18.824501 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:18.892819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:18.897034 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f4ba41d7-7575-4b64-8487-6431e4a59ad8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:18.959611 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:18.962593 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:18.966977 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:20:19.008686 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Pushing event updated for resources: {'Port': ['ID=2d91e003-e7a9-4c22-9a99-1564da9f0717,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:19.014238 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:19.422856 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e9ca5a-5856-4484-b113-02e43566ea18 req-f57bf476-eebc-49b3-9211-c839dbdeaa85 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:19.428908 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-84e9ca5a-5856-4484-b113-02e43566ea18 req-f57bf476-eebc-49b3-9211-c839dbdeaa85 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.2077112
May 20 16:20:19.479817 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-84e9ca5a-5856-4484-b113-02e43566ea18 req-320996ad-2d57-42ae-978b-b6c71d596505 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481730
May 20 16:20:19.493801 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 127ab9e0-c76f-4414-a97d-c9566d01d190 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:19.686948 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:19.715474 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 127ab9e0-c76f-4414-a97d-c9566d01d190 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:19.720947 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 127ab9e0-c76f-4414-a97d-c9566d01d190 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:19.723129 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:19.746606 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:19.834379 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-498d4f7a-1176-4b81-9b09-3e5b6b82123f req-e7c6dc0f-9aaa-414d-8616-77330bcbee15 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:19.838095 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-498d4f7a-1176-4b81-9b09-3e5b6b82123f req-e7c6dc0f-9aaa-414d-8616-77330bcbee15 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1888630
May 20 16:20:19.866597 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:19.903441 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 127ab9e0-c76f-4414-a97d-c9566d01d190, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=127ab9e0-c76f-4414-a97d-c9566d01d190,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:19.953883 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13cc4c91-00fe-4714-a5e3-9bd80ef5bbee None None] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:20:19.965794 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-498d4f7a-1176-4b81-9b09-3e5b6b82123f req-5348a6f0-3dc1-40d6-ba50-3bd157bac369 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1172097
May 20 16:20:20.053248 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:20.054270 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ad2f35e3-ad29-49c3-aa78-af3083c41efb up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:20.092167 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:20.154169 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:20.260451 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=127ab9e0-c76f-4414-a97d-c9566d01d190,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:20.267172 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:20.352299 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-68234199-05a6-447a-80a2-04d3eaaaafaf None None] Provisioning for port ad2f35e3-ad29-49c3-aa78-af3083c41efb completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:20.408780 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port ad2f35e3-ad29-49c3-aa78-af3083c41efb completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:20.414228 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port ad2f35e3-ad29-49c3-aa78-af3083c41efb triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:20.414612 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:20.539622 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:20.563615 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Router f9ebaaaf-9e9b-4128-9058-4315baa484e1 is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92421) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:20:20.579568 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port ad2f35e3-ad29-49c3-aa78-af3083c41efb, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ad2f35e3-ad29-49c3-aa78-af3083c41efb,segment=NetworkSegment(5693de47-397e-4e5a-878b-f95a4a1ed194),segment_id=5693de47-397e-4e5a-878b-f95a4a1ed194)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:20.587340 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-97bbafc3-5326-4609-8c9c-e7e2b8ce54cc None None] Provisioning complete for port ad2f35e3-ad29-49c3-aa78-af3083c41efb triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:20.588316 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-97bbafc3-5326-4609-8c9c-e7e2b8ce54cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:20.716648 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-97bbafc3-5326-4609-8c9c-e7e2b8ce54cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:20.751143 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:20.751143 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:20.864713 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.db.api [None req-97bbafc3-5326-4609-8c9c-e7e2b8ce54cc None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=92423) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 20 16:20:20.865098 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_db.api [None req-97bbafc3-5326-4609-8c9c-e7e2b8ce54cc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 20 16:20:20.868537 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=ad2f35e3-ad29-49c3-aa78-af3083c41efb,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:20.871684 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:20.938021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:20:20.946627 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Sync routers for ids ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:20:20.956054 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Routers {'f9ebaaaf-9e9b-4128-9058-4315baa484e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:20.959548 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe713898dc0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:20.969475 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d924e9a-d342-4f06-8ab4-13dfb114647d req-1d3b3200-331e-44a6-888a-2cae2523e711 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:20.970945 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d924e9a-d342-4f06-8ab4-13dfb114647d req-1d3b3200-331e-44a6-888a-2cae2523e711 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.2968407
May 20 16:20:21.019524 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d924e9a-d342-4f06-8ab4-13dfb114647d req-7b0fcef1-6529-4779-980a-360a404876a1 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423834
May 20 16:20:21.039624 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:21.042110 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 4.0161242
May 20 16:20:21.050750 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33684) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:21.168347 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Set router f9ebaaaf-9e9b-4128-9058-4315baa484e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:21.208823 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9167a940-1be1-4c87-8b57-2191f712b70e req-fb255299-2f56-41b8-aed5-c204aff1ed08 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:21.210564 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9167a940-1be1-4c87-8b57-2191f712b70e req-fb255299-2f56-41b8-aed5-c204aff1ed08 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0925691
May 20 16:20:21.261696 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9167a940-1be1-4c87-8b57-2191f712b70e req-15d8a95a-9a60-4306-9de1-f2b5db4f0079 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441859
May 20 16:20:21.294865 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:21.455052 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 127ab9e0-c76f-4414-a97d-c9566d01d190 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:21.507316 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe713898dc0>, [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 3, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:21.512259 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Checking router: f9ebaaaf-9e9b-4128-9058-4315baa484e1 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:20:21.512720 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Updating router f9ebaaaf-9e9b-4128-9058-4315baa484e1 port 2d91e003-e7a9-4c22-9a99-1564da9f0717 binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:20:21.524801 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 127ab9e0-c76f-4414-a97d-c9566d01d190 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:21.525291 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:21.565775 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:21.650532 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ad2f35e3-ad29-49c3-aa78-af3083c41efb up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:21.722949 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port ad2f35e3-ad29-49c3-aa78-af3083c41efb triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:21.723465 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:21.766751 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:21.940343 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:21.952647 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Transition to ACTIVE for port object 2d91e003-e7a9-4c22-9a99-1564da9f0717 will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:22.009213 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.014447 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:22.069955 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Allocated IP 172.20.0.1 (3e35d18a-64e2-4e37-8db1-1c472e3454f2/bb854cba-1e3d-40b4-a869-9a7d16f7d6a9/096042a0-8761-46e2-813e-5de741a4f5fa) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:20:22.095819 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524096e9-ef59-4cda-b617-86eb0c32e2ee None None] Pushing event updated for resources: {'Port': ['ID=2d91e003-e7a9-4c22-9a99-1564da9f0717,revision_number=2']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:22.098504 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Attempting to bind port 2d91e003-e7a9-4c22-9a99-1564da9f0717 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:20:22.099447 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Attempting to bind port 2d91e003-e7a9-4c22-9a99-1564da9f0717 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:20:22.099447 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Attempting to bind port 2d91e003-e7a9-4c22-9a99-1564da9f0717 on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:20:22.101747 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-524096e9-ef59-4cda-b617-86eb0c32e2ee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:22.107071 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 20, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:20:22.107477 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:22.107875 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.108325 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:20:22.108787 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Bound port: 2d91e003-e7a9-4c22-9a99-1564da9f0717, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:20:22.109151 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.188514 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] For port 2d91e003-e7a9-4c22-9a99-1564da9f0717, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:20:22.193250 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] For port 2d91e003-e7a9-4c22-9a99-1564da9f0717, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=2d91e003-e7a9-4c22-9a99-1564da9f0717,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:20:22.230091 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4077d19e-6a89-4a60-aa52-21bd6c03dc0b req-eda6bf7a-131c-4b83-8a4e-a23cd0f5eeb4 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:22.232404 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4077d19e-6a89-4a60-aa52-21bd6c03dc0b req-eda6bf7a-131c-4b83-8a4e-a23cd0f5eeb4 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.0907068
May 20 16:20:22.243962 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.259991 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Transition to ACTIVE for port object 096042a0-8761-46e2-813e-5de741a4f5fa will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:22.284989 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4077d19e-6a89-4a60-aa52-21bd6c03dc0b req-73d3b7df-eed8-41d9-91c2-73de62d5d333 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461352
May 20 16:20:22.324083 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.328210 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:22.414614 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Routers {'f9ebaaaf-9e9b-4128-9058-4315baa484e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:22.416213 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe713898dc0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:22.425383 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.430486 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:22.482089 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b8dc85-ed62-4a29-9798-1422ce3219d1 req-9681dfcd-1050-4533-8008-7e86954b15a9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:22.492394 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b8dc85-ed62-4a29-9798-1422ce3219d1 req-9681dfcd-1050-4533-8008-7e86954b15a9 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1042027
May 20 16:20:22.563492 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b8dc85-ed62-4a29-9798-1422ce3219d1 req-721fcdab-9f75-4e03-b35d-1144acaebbbd tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0667429
May 20 16:20:22.582166 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524096e9-ef59-4cda-b617-86eb0c32e2ee None None] Pushing event updated for resources: {'Port': ['ID=2d91e003-e7a9-4c22-9a99-1564da9f0717,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:22.583313 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:22.585974 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-524096e9-ef59-4cda-b617-86eb0c32e2ee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:22.586308 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:22.590838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:20:22.649397 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Pushing event updated for resources: {'Port': ['ID=096042a0-8761-46e2-813e-5de741a4f5fa,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:22.653476 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:22.689867 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.726597 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] Set router f9ebaaaf-9e9b-4128-9058-4315baa484e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:22.939517 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:22.972417 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-42ba4b87-1a1c-4126-8058-0807c1441763 None None] Provisioning for port 096042a0-8761-46e2-813e-5de741a4f5fa completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:22.979087 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-42ba4b87-1a1c-4126-8058-0807c1441763 None None] Provisioning complete for port 096042a0-8761-46e2-813e-5de741a4f5fa triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:22.979557 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-42ba4b87-1a1c-4126-8058-0807c1441763 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:23.047092 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe713898dc0>, [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 3, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:23.054622 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfb8f1da-5a78-40c0-ab91-28afa97e8d5f None None] The sync data for ids ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'] in dv-cinder-689486-13-iscsi is: [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 3, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:20:23.074138 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-42ba4b87-1a1c-4126-8058-0807c1441763 None None] Port 096042a0-8761-46e2-813e-5de741a4f5fa cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:20:23.206025 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:23.379318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:23.420188 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3520ee4a-9dee-4016-8b8f-2f052d3c78ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:23.512381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Pushing event updated for resources: {'Port': ['ID=096042a0-8761-46e2-813e-5de741a4f5fa,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:23.529841 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 2d91e003-e7a9-4c22-9a99-1564da9f0717 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:23.530091 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:23.548778 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8d4075-8e83-4e52-bdba-94081b8d4f69 req-111f795d-3232-462d-9526-fdb07f753c9c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:23.550314 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9c8d4075-8e83-4e52-bdba-94081b8d4f69 req-111f795d-3232-462d-9526-fdb07f753c9c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.1478438
May 20 16:20:23.554910 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:23.621465 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9c8d4075-8e83-4e52-bdba-94081b8d4f69 req-1037f2b3-2828-45ed-bb66-29099354587f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0643265
May 20 16:20:23.769143 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 2d91e003-e7a9-4c22-9a99-1564da9f0717 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:23.776569 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 2d91e003-e7a9-4c22-9a99-1564da9f0717 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:23.777514 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:23.814438 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:20:23.817262 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:20:23.835692 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b34b2bbd-f80e-44eb-bb30-90f0a73d54f6 req-d5707f8a-70ef-48b4-b9fd-8335d35a5282 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:23.839025 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b34b2bbd-f80e-44eb-bb30-90f0a73d54f6 req-d5707f8a-70ef-48b4-b9fd-8335d35a5282 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1378469
May 20 16:20:23.928524 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b34b2bbd-f80e-44eb-bb30-90f0a73d54f6 req-6f172350-63a2-456b-a3e9-82909e527bf0 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0812793
May 20 16:20:23.963610 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:23.980822 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 2d91e003-e7a9-4c22-9a99-1564da9f0717, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=2d91e003-e7a9-4c22-9a99-1564da9f0717,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:24.066878 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Router f9ebaaaf-9e9b-4128-9058-4315baa484e1 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:20:24.112729 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-5b4c263b-a83e-4ec2-969a-952f15202ecf None None] Provisioning complete for port 096042a0-8761-46e2-813e-5de741a4f5fa triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:24.113099 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5b4c263b-a83e-4ec2-969a-952f15202ecf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:24.142316 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:24.152371 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:24.221571 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-5b4c263b-a83e-4ec2-969a-952f15202ecf None None] Port 096042a0-8761-46e2-813e-5de741a4f5fa cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:20:24.234975 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=2d91e003-e7a9-4c22-9a99-1564da9f0717,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:24.238391 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:24.257511 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:20:24.268308 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] 10.222.0.64 "PUT /v2.0/routers/f9ebaaaf-9e9b-4128-9058-4315baa484e1/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.2161355
May 20 16:20:24.897544 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Sync routers for ids ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:20:24.909642 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Routers {'f9ebaaaf-9e9b-4128-9058-4315baa484e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:24.910224 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712f164c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:25.027370 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33758) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:25.032758 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-965044844', 'description': 'tempest-secgroup-smoke-965044844 description', 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:25.038827 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:25.043235 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:25.047362 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:25.089184 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:25.101837 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Set router f9ebaaaf-9e9b-4128-9058-4315baa484e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:25.139414 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86de79d0-bc73-4ed0-8d0d-253a2d489c70 req-335102a5-9d64-47da-b931-d1ca637d70fb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:25.140982 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-86de79d0-bc73-4ed0-8d0d-253a2d489c70 req-335102a5-9d64-47da-b931-d1ca637d70fb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.0948217
May 20 16:20:25.192561 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-86de79d0-bc73-4ed0-8d0d-253a2d489c70 req-a9d5fb0b-a51a-4540-b637-b3aef0434bd1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431592
May 20 16:20:25.260966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:25.282368 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:25.286314 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:25.289268 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:25.294970 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:25.385013 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:25.429819 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 2d91e003-e7a9-4c22-9a99-1564da9f0717 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:25.467119 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712f164c0>, [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:20:22Z', 'revision_number': 4, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '096042a0-8761-46e2-813e-5de741a4f5fa', 'name': '', 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'mac_address': 'fa:16:3e:9f:81:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_interface', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': 'bb854cba-1e3d-40b4-a869-9a7d16f7d6a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:21Z', 'updated_at': '2021-05-20T16:20:23Z', 'revision_number': 2, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'subnets': [{'id': 'bb854cba-1e3d-40b4-a869-9a7d16f7d6a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:25.479457 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Checking router: f9ebaaaf-9e9b-4128-9058-4315baa484e1 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:20:25.479810 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Updating router f9ebaaaf-9e9b-4128-9058-4315baa484e1 port 096042a0-8761-46e2-813e-5de741a4f5fa binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:20:25.539587 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:25.549915 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:25.556815 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2ba34e21-9caf-4050-b650-d5e6d19cc090 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:25.591579 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 2d91e003-e7a9-4c22-9a99-1564da9f0717 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:25.591870 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:25.642819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'SecurityGroup': ['ID=af364d12-8f8f-41f5-b04f-0618bf1f0081,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:25.648301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:25.735004 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:25.735912 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.7075257
May 20 16:20:25.739117 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33772) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:25.748810 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'security_group_rule': {'security_group_id': 'af364d12-8f8f-41f5-b04f-0618bf1f0081', 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:25.764804 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:25.771332 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:25.784307 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:25.795495 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:25.927714 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.002362 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.059599 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.128137 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Transition to ACTIVE for port object 096042a0-8761-46e2-813e-5de741a4f5fa will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:20:26.200687 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.203040 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:26.233878 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ecae6d9-75b3-487b-ac4e-86d057e47713,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:26.241188 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:26.315668 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.319718 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:26.461827 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.466595 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.7243633
May 20 16:20:26.466595 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33786) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:26.473090 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'security_group_rule': {'security_group_id': 'af364d12-8f8f-41f5-b04f-0618bf1f0081', 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:26.486642 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:26.503660 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:26.524430 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:26.538222 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1baed4fb-18ee-4ae8-98c2-06f7ca5db9a2 None None] Pushing event updated for resources: {'Port': ['ID=096042a0-8761-46e2-813e-5de741a4f5fa,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:26.553254 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:26.588088 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-1baed4fb-18ee-4ae8-98c2-06f7ca5db9a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:26.625173 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-2fd9619d-ccc9-4442-8656-b34e98415844 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:26.626536 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-2fd9619d-ccc9-4442-8656-b34e98415844 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Synchronizing usage tracker for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:20:26.722089 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162a0539-8f84-4917-9539-0098272c8ae9 req-8abf3ce2-dc33-4353-bf5a-f9382f8c0de1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:26.723557 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-162a0539-8f84-4917-9539-0098272c8ae9 req-8abf3ce2-dc33-4353-bf5a-f9382f8c0de1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.1592724
May 20 16:20:26.726020 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.746694 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-2fd9619d-ccc9-4442-8656-b34e98415844 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Unset dirty status for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:20:26.747909 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-2fd9619d-ccc9-4442-8656-b34e98415844 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 946 time: 0.3002324
May 20 16:20:26.803484 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430911ac-cc4b-43fb-96dd-7131455e7c21 req-add17d28-db36-47ba-960e-cc6728de88d7 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:26.812354 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-430911ac-cc4b-43fb-96dd-7131455e7c21 req-add17d28-db36-47ba-960e-cc6728de88d7 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.1758592
May 20 16:20:26.841796 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-162a0539-8f84-4917-9539-0098272c8ae9 req-ee9eb708-40ef-41b2-97bc-dd37e29ad995 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1087203
May 20 16:20:26.876186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:26.884844 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-430911ac-cc4b-43fb-96dd-7131455e7c21 req-8aa7d6b9-c8d6-4456-8ffa-251f29f6c624 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0696983
May 20 16:20:26.994804 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Deleting port 12e95041-05fa-4910-ada4-e349ed594896 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:26.995136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.042725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.048735 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:27.068776 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1dfe29b-f450-48d0-91b6-4b0bbbfcd061,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:27.071340 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:27.133969 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] For port 12e95041-05fa-4910-ada4-e349ed594896, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=12e95041-05fa-4910-ada4-e349ed594896,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:27.134349 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.219459 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Attempting to bind port 096042a0-8761-46e2-813e-5de741a4f5fa on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:20:27.220131 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Attempting to bind port 096042a0-8761-46e2-813e-5de741a4f5fa by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:20:27.220262 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Attempting to bind port 096042a0-8761-46e2-813e-5de741a4f5fa on network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:20:27.225804 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 20, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:20:27.226178 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Checking segment: {'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:27.226573 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.226969 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Bound using segment: {'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:20:27.227477 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Bound port: 096042a0-8761-46e2-813e-5de741a4f5fa, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5693de47-397e-4e5a-878b-f95a4a1ed194', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:20:27.228372 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.261059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Calling delete_port for 12e95041-05fa-4910-ada4-e349ed594896 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:27.360735 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] For port 096042a0-8761-46e2-813e-5de741a4f5fa, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:20:27.366415 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] For port 096042a0-8761-46e2-813e-5de741a4f5fa, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=096042a0-8761-46e2-813e-5de741a4f5fa,segment=NetworkSegment(5693de47-397e-4e5a-878b-f95a4a1ed194),segment_id=5693de47-397e-4e5a-878b-f95a4a1ed194)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:20:27.368766 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.371413 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.9034064
May 20 16:20:27.374118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33800) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:27.381855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'security_group_rule': {'security_group_id': 'af364d12-8f8f-41f5-b04f-0618bf1f0081', 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:27.388975 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:27.393374 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:27.396389 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:27.403605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:27.496163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.507664 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.507979 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.508337 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5f353749-06c7-4c62-bbdc-db216391049c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:27.516699 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-87bbd950-362f-4150-b9c8-dd522bbf50c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:27.548161 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['12e95041-05fa-4910-ada4-e349ed594896', '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:27.561334 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Pushing event deleted for resources: {'Port': ['ID=12e95041-05fa-4910-ada4-e349ed594896,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:27.569715 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:27.577554 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.655349 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Routers {'f9ebaaaf-9e9b-4128-9058-4315baa484e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:27.655951 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712f164c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:27.669469 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] No DVR routers for this DVR port 12e95041-05fa-4910-ada4-e349ed594896 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:20:27.673681 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.684741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'name': 'network-vif-deleted', 'tag': '12e95041-05fa-4910-ada4-e349ed594896'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:27.737164 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04f2f9e2-17b2-4fbd-ad5a-93f902d18121', 'name': 'network-vif-deleted', 'tag': '12e95041-05fa-4910-ada4-e349ed594896', 'status': 'completed', 'code': 200}
May 20 16:20:27.751354 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.757968 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1baed4fb-18ee-4ae8-98c2-06f7ca5db9a2 None None] Pushing event updated for resources: {'Port': ['ID=096042a0-8761-46e2-813e-5de741a4f5fa,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:27.763627 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-1baed4fb-18ee-4ae8-98c2-06f7ca5db9a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:27.765761 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-dc421c10-13e2-482d-b90c-c48bcdfff7ec tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:27.788708 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6a07a9cf-e30c-46bd-b3d8-1e65457663b7 req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "DELETE /v2.0/ports/12e95041-05fa-4910-ada4-e349ed594896 HTTP/1.1" status: 204  len: 173 time: 1.0278339
May 20 16:20:27.806243 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd4b2206-da43-4f69-a37d-7c29b03c6870,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:27.812920 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:27.857321 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30a4f66-51e2-4639-a17e-4a82f0a7512e req-ff963901-669c-440f-8b3d-15e63e1a38e6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:27.858882 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a30a4f66-51e2-4639-a17e-4a82f0a7512e req-ff963901-669c-440f-8b3d-15e63e1a38e6 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 945 time: 0.1510937
May 20 16:20:27.927056 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a30a4f66-51e2-4639-a17e-4a82f0a7512e req-83c45e3a-b55c-429c-90f8-38949801b0c3 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0614810
May 20 16:20:27.939332 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:27.942184 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] Set router f9ebaaaf-9e9b-4128-9058-4315baa484e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:27.942584 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-92b0d7af-1c3f-46b5-9d0b-691f75ceb756 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.5609007
May 20 16:20:27.942683 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33818) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:27.950752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'security_group_rule': {'security_group_id': 'af364d12-8f8f-41f5-b04f-0618bf1f0081', 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:27.958925 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:27.971036 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:27.976308 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:27.999868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:28.062957 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03d6f608-91bf-4f1c-b083-2008823ea13e req-0fb3c268-aa47-4aff-9959-a0ff57b4c781 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 210 time: 0.0841482
May 20 16:20:28.158469 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.164815 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-166a4122-6d58-40ca-ac48-894d2b20046a req-3611ff07-fb56-453a-bccc-9d6ca69ad92e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:28.166768 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-166a4122-6d58-40ca-ac48-894d2b20046a req-3611ff07-fb56-453a-bccc-9d6ca69ad92e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.0932159
May 20 16:20:28.215565 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-166a4122-6d58-40ca-ac48-894d2b20046a req-a93dc998-ea59-43ca-82d4-4bc04ef2381f tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422916
May 20 16:20:28.227988 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.312058 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712f164c0>, [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:20:22Z', 'revision_number': 4, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '096042a0-8761-46e2-813e-5de741a4f5fa', 'name': '', 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'mac_address': 'fa:16:3e:9f:81:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_interface', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': 'bb854cba-1e3d-40b4-a869-9a7d16f7d6a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:21Z', 'updated_at': '2021-05-20T16:20:27Z', 'revision_number': 4, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'subnets': [{'id': 'bb854cba-1e3d-40b4-a869-9a7d16f7d6a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:28.316012 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3314880e-5fe4-4592-8588-29caf481eb12 None None] The sync data for ids ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'] in dv-cinder-689486-13-iscsi is: [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:20:22Z', 'revision_number': 4, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '096042a0-8761-46e2-813e-5de741a4f5fa', 'name': '', 'network_id': '3e35d18a-64e2-4e37-8db1-1c472e3454f2', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'mac_address': 'fa:16:3e:9f:81:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_interface', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': 'bb854cba-1e3d-40b4-a869-9a7d16f7d6a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:21Z', 'updated_at': '2021-05-20T16:20:27Z', 'revision_number': 4, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'subnets': [{'id': 'bb854cba-1e3d-40b4-a869-9a7d16f7d6a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:20:28.385151 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.391156 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:28.422449 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b8313bd7-7ef3-4c74-8060-e1460d1d4276,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:28.425005 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:28.521154 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.522428 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f0b7c253-0100-4473-a261-5b89dc541839 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.5787284
May 20 16:20:28.525282 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 33822) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:28.546977 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'security_group_rule': {'security_group_id': 'af364d12-8f8f-41f5-b04f-0618bf1f0081', 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:28.546977 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:28.546977 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:28.546977 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:28.550680 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:28.597574 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.644118 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.securitygroups_db [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Project b05498ab061b462e9f28e7d5e6bff55e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 16:20:28.650395 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.734749 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.855199 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:28.861757 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:28.897319 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d9912f0c-0c83-4772-8021-9e74edc44385,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:28.900681 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:29.033980 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:29.037884 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.5089080
May 20 16:20:29.044435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 33840) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:29.044435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'security_group_rule': {'security_group_id': 'af364d12-8f8f-41f5-b04f-0618bf1f0081', 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:29.050229 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:29.054631 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:security_group_rule and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:29.057915 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:29.062295 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-da88d501-d8be-4bf6-b62b-ee521aa023f6 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:29.067526 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-da88d501-d8be-4bf6-b62b-ee521aa023f6 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Synchronizing usage tracker for tenant:bfea173096cf4b509735ffd535193ea5 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:20:29.122083 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:29.167964 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8a8a883-82d2-4e1b-91d9-2652b89a6939 req-5244a69d-81ae-4bc1-b30e-318918d1a127 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:29.172018 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f8a8a883-82d2-4e1b-91d9-2652b89a6939 req-5244a69d-81ae-4bc1-b30e-318918d1a127 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 945 time: 0.1078517
May 20 16:20:29.198080 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-da88d501-d8be-4bf6-b62b-ee521aa023f6 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Unset dirty status for tenant:bfea173096cf4b509735ffd535193ea5 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:20:29.199282 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-da88d501-d8be-4bf6-b62b-ee521aa023f6 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.2571857
May 20 16:20:29.218386 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f8a8a883-82d2-4e1b-91d9-2652b89a6939 req-33c2f79d-c9c0-43a4-b5af-58b8e389383a tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426803
May 20 16:20:29.258579 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.securitygroups_db [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Project b05498ab061b462e9f28e7d5e6bff55e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 16:20:29.314707 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:29.391048 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Deleting port ac62015d-43b6-486e-8e19-31bdbf3093d8 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:29.391665 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:29.585292 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 096042a0-8761-46e2-813e-5de741a4f5fa up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:29.716655 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] For port ac62015d-43b6-486e-8e19-31bdbf3093d8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=ac62015d-43b6-486e-8e19-31bdbf3093d8,segment=NetworkSegment(586db0b1-2bc2-4dce-8d66-88ecd6bc05d3),segment_id=586db0b1-2bc2-4dce-8d66-88ecd6bc05d3)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:29.717020 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:29.762546 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b82f4506-3d92-4c54-a37a-dbbdd77bee32 req-49a7b05f-014b-4e90-8430-57c6402c5202 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=04f2f9e2-17b2-4fbd-ad5a-93f902d18121 HTTP/1.1" status: 200  len: 210 time: 0.2908154
May 20 16:20:29.798084 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 096042a0-8761-46e2-813e-5de741a4f5fa completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:20:29.806746 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 096042a0-8761-46e2-813e-5de741a4f5fa triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:29.812150 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:29.859266 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Calling delete_port for ac62015d-43b6-486e-8e19-31bdbf3093d8 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:29.882580 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:29.913888 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8dbf52-0a32-413f-82f7-fd4321d2e6ab req-d7ee9a9d-c150-4d84-854f-705a8859e550 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:29.915544 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2e8dbf52-0a32-413f-82f7-fd4321d2e6ab req-d7ee9a9d-c150-4d84-854f-705a8859e550 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 946 time: 0.1570969
May 20 16:20:29.932370 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 12e95041-05fa-4910-ada4-e349ed594896 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:29.979407 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2e8dbf52-0a32-413f-82f7-fd4321d2e6ab req-ecc80733-b189-4cdb-b62e-e7fe9f00138c tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/security-groups?id=04045ca2-7857-4449-8fcc-f44af2699567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0572491
May 20 16:20:29.992068 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 12e95041-05fa-4910-ada4-e349ed594896 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:29.992068 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 12e95041-05fa-4910-ada4-e349ed594896 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:30.006908 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:30.041017 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 096042a0-8761-46e2-813e-5de741a4f5fa, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=096042a0-8761-46e2-813e-5de741a4f5fa,segment=NetworkSegment(5693de47-397e-4e5a-878b-f95a4a1ed194),segment_id=5693de47-397e-4e5a-878b-f95a4a1ed194)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:30.054488 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:30.058884 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-95f994a7-9aee-423f-b384-6373576a35aa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:30.084608 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=166f23c0-070f-4728-bda5-be2edc70bac7,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:30.087395 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:30.146225 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:30.151981 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:30.168830 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['ac62015d-43b6-486e-8e19-31bdbf3093d8'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:30.198166 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Pushing event deleted for resources: {'Port': ['ID=ac62015d-43b6-486e-8e19-31bdbf3093d8,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:30.220109 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:30.221910 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:30.228956 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:30.278513 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] No DVR routers for this DVR port ac62015d-43b6-486e-8e19-31bdbf3093d8 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:20:30.281198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:30.285178 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'name': 'network-vif-deleted', 'tag': 'ac62015d-43b6-486e-8e19-31bdbf3093d8'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:30.305963 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:30.314779 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 1.2686577
May 20 16:20:30.325836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=096042a0-8761-46e2-813e-5de741a4f5fa,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:30.338019 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:30.357951 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b28dc30f-5586-4327-b2d3-0fb8747d99e9', 'name': 'network-vif-deleted', 'tag': 'ac62015d-43b6-486e-8e19-31bdbf3093d8', 'status': 'completed', 'code': 200}
May 20 16:20:30.394451 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-5cfa5bd6-7339-4625-a373-1533db8a9707 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:30.395074 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-5cfa5bd6-7339-4625-a373-1533db8a9707 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Synchronizing usage tracker for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:20:30.409313 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-679e11b7-84c4-43fd-9a32-a1c2048b6e97 req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.16 "DELETE /v2.0/ports/ac62015d-43b6-486e-8e19-31bdbf3093d8 HTTP/1.1" status: 204  len: 173 time: 1.2027678
May 20 16:20:30.474867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbfcb2d-0623-4404-afcf-0d77d3dc8dcd req-c578cc22-0ad2-48b0-bbc3-c8968ab7da67 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:30.476351 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cdbfcb2d-0623-4404-afcf-0d77d3dc8dcd req-c578cc22-0ad2-48b0-bbc3-c8968ab7da67 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 945 time: 0.0965273
May 20 16:20:30.535594 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cdbfcb2d-0623-4404-afcf-0d77d3dc8dcd req-532739c0-f1a0-40d4-8c8c-accc14ec36a4 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528023
May 20 16:20:30.549638 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-5cfa5bd6-7339-4625-a373-1533db8a9707 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Unset dirty status for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:20:30.550821 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-5cfa5bd6-7339-4625-a373-1533db8a9707 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 945 time: 0.2463386
May 20 16:20:30.770212 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Deleting port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:30.770557 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:30.917943 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] For port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:30.918669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:31.050887 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Calling delete_port for 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:31.146421 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-96724251-28b5-4d2c-b94c-ce388578bfaa req-55fc0be6-b9b3-4ea1-a673-8432c3d8ffa8 tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] 10.222.0.64 "GET /v2.0/ports?device_id=b28dc30f-5586-4327-b2d3-0fb8747d99e9 HTTP/1.1" status: 200  len: 210 time: 0.0433698
May 20 16:20:31.267215 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:31.267434 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dfc16bae-89dd-4db4-9ded-74caee09024d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:31.281746 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f', 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', '5948d4d9-4307-4294-a458-260cc0b0d3d4', '51bfa597-72ba-47c7-b8e7-ebd34fd1b827'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:31.326905 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event deleted for resources: {'Port': ['ID=51bfa597-72ba-47c7-b8e7-ebd34fd1b827,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:31.331569 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:31.424348 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] No DVR routers for this DVR port 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:20:31.427100 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:31.453837 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 096042a0-8761-46e2-813e-5de741a4f5fa up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:20:31.615506 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-31e7fd3c-5e03-4d9d-b65f-e20dbe995ef3 req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "DELETE /v2.0/ports/51bfa597-72ba-47c7-b8e7-ebd34fd1b827 HTTP/1.1" status: 204  len: 173 time: 1.0576959
May 20 16:20:31.668035 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 096042a0-8761-46e2-813e-5de741a4f5fa triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:20:31.675802 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:31.782315 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5c52ef0a-06ac-4998-a96e-e3c3511891e9 req-a983d77f-08af-4622-93a9-d7e7ce8dfc4c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.1296852
May 20 16:20:31.861085 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d00b6105-2b5e-4418-8034-40c9db8936d0 req-941166f6-f738-4459-bbbb-1a8049b17cd6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:31.862853 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d00b6105-2b5e-4418-8034-40c9db8936d0 req-941166f6-f738-4459-bbbb-1a8049b17cd6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1265752
May 20 16:20:31.916219 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d00b6105-2b5e-4418-8034-40c9db8936d0 req-c2dbcded-a50f-45e0-9356-6d3543e0950f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458341
May 20 16:20:32.359572 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7902b3ab-c575-46b6-853a-8705c994ff11', 'name': 'network-vif-deleted', 'tag': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:32.460994 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7902b3ab-c575-46b6-853a-8705c994ff11', 'name': 'network-vif-deleted', 'tag': '51bfa597-72ba-47c7-b8e7-ebd34fd1b827', 'status': 'completed', 'code': 200}
May 20 16:20:32.618245 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc65378-eb59-44df-be72-418dbe72e7bf req-95c77095-35e1-4b9e-8593-6013b317d356 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:32.620387 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bdc65378-eb59-44df-be72-418dbe72e7bf req-95c77095-35e1-4b9e-8593-6013b317d356 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 945 time: 0.0920434
May 20 16:20:32.668857 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bdc65378-eb59-44df-be72-418dbe72e7bf req-4daed6a2-7cbc-424e-8e0f-20cddbb07ed6 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422173
May 20 16:20:33.172686 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ab9f662-2282-4a08-9b03-62086f5ce5b2 req-9166d610-f7da-46d9-8bbd-e630f74190ea tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=7902b3ab-c575-46b6-853a-8705c994ff11 HTTP/1.1" status: 200  len: 210 time: 0.0511003
May 20 16:20:33.207897 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6a503b-cacf-4391-ba8e-0576b3167acd req-f12f93d9-ec75-4a59-9141-efdd7ec3af94 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:33.213609 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f6a503b-cacf-4391-ba8e-0576b3167acd req-f12f93d9-ec75-4a59-9141-efdd7ec3af94 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1414123
May 20 16:20:33.263536 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f6a503b-cacf-4391-ba8e-0576b3167acd req-cb5bb7c6-9718-4214-be66-503c5c4714f5 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456529
May 20 16:20:33.859306 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fca13d-d77a-4228-82a0-dde5ed42828b req-d662e9fe-01ad-4f59-b2ac-2ba95dab45b6 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:33.860726 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-56fca13d-d77a-4228-82a0-dde5ed42828b req-d662e9fe-01ad-4f59-b2ac-2ba95dab45b6 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 945 time: 0.0812376
May 20 16:20:33.905597 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:33.918883 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-56fca13d-d77a-4228-82a0-dde5ed42828b req-1d18ae64-2386-48d9-8b10-d7daf554b4a1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0521123
May 20 16:20:33.946197 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:33.947065 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 51bfa597-72ba-47c7-b8e7-ebd34fd1b827 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:33.947531 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device ac62015d-43b6-486e-8e19-31bdbf3093d8 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:33.981830 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: ac62015d-43b6-486e-8e19-31bdbf3093d8 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:33.982443 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device ac62015d-43b6-486e-8e19-31bdbf3093d8 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:34.464813 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772d23be-85b6-4634-81c3-bd2b53892a44 req-ffcaf61f-ea47-4659-b8f6-e7dbbd24596a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:34.466175 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772d23be-85b6-4634-81c3-bd2b53892a44 req-ffcaf61f-ea47-4659-b8f6-e7dbbd24596a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0896297
May 20 16:20:34.511330 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772d23be-85b6-4634-81c3-bd2b53892a44 req-b622dd82-5ae2-4cd1-924a-6194e992de09 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389745
May 20 16:20:35.129790 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17000de0-73c4-4a43-bad2-810df42612e9 req-63c18432-731b-424c-9be8-4a395ad3f18d tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:35.135236 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-17000de0-73c4-4a43-bad2-810df42612e9 req-63c18432-731b-424c-9be8-4a395ad3f18d tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 945 time: 0.1034145
May 20 16:20:35.156340 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-b59c6c1d-d47d-43bc-adfd-ca4d018d2ccf tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:35.157181 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-b59c6c1d-d47d-43bc-adfd-ca4d018d2ccf tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Synchronizing usage tracker for tenant:685f156c43064dcf8880e8af97070ea9 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:20:35.178508 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-17000de0-73c4-4a43-bad2-810df42612e9 req-babcd402-b7ce-4173-915b-9dda8b5965f8 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404365
May 20 16:20:35.269359 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-b59c6c1d-d47d-43bc-adfd-ca4d018d2ccf tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Unset dirty status for tenant:685f156c43064dcf8880e8af97070ea9 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:20:35.270551 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-b59c6c1d-d47d-43bc-adfd-ca4d018d2ccf tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 945 time: 0.2220635
May 20 16:20:35.416730 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Deleting port 82c98f0c-1ea5-462d-9be5-cd913e8b063c {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:35.417075 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:35.561957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] For port 82c98f0c-1ea5-462d-9be5-cd913e8b063c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=82c98f0c-1ea5-462d-9be5-cd913e8b063c,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:35.562423 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:35.687103 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Calling delete_port for 82c98f0c-1ea5-462d-9be5-cd913e8b063c owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:35.706430 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff93a82-6b4c-44fa-a18a-2cbd6cefba99 req-50478fc0-b9e5-4bd4-915d-616fb0fc1d3d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:35.708056 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9ff93a82-6b4c-44fa-a18a-2cbd6cefba99 req-50478fc0-b9e5-4bd4-915d-616fb0fc1d3d tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0807505
May 20 16:20:35.770646 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9ff93a82-6b4c-44fa-a18a-2cbd6cefba99 req-a5c9a051-3f06-421e-b8af-3b0e081d748c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0557227
May 20 16:20:35.940245 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:35.946280 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:35.953136 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['82c98f0c-1ea5-462d-9be5-cd913e8b063c'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:35.993986 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Pushing event deleted for resources: {'Port': ['ID=82c98f0c-1ea5-462d-9be5-cd913e8b063c,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:35.997492 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:36.074032 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] No DVR routers for this DVR port 82c98f0c-1ea5-462d-9be5-cd913e8b063c on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:20:36.076535 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:36.079101 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'name': 'network-vif-deleted', 'tag': '82c98f0c-1ea5-462d-9be5-cd913e8b063c'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:36.128684 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bae1254f-ade8-46a7-9be9-068ba9e9d258', 'name': 'network-vif-deleted', 'tag': '82c98f0c-1ea5-462d-9be5-cd913e8b063c', 'status': 'completed', 'code': 200}
May 20 16:20:36.247342 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2cf5fc24-9316-40ae-8900-39a5f5a510e7 req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "DELETE /v2.0/ports/82c98f0c-1ea5-462d-9be5-cd913e8b063c HTTP/1.1" status: 204  len: 173 time: 0.9697332
May 20 16:20:36.348856 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-30151ae8-fcf7-4ad4-a682-89e83f4c7b38 req-f52544cc-4f71-4ba4-8e18-4706a06a79a4 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 210 time: 0.0518315
May 20 16:20:36.611995 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fb2701-be25-4d13-9447-7f34ba75694d req-a11e84e0-b2c2-4e04-bd8f-0e757ee0918b tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:36.613757 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3fb2701-be25-4d13-9447-7f34ba75694d req-a11e84e0-b2c2-4e04-bd8f-0e757ee0918b tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.0796697
May 20 16:20:36.663976 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3fb2701-be25-4d13-9447-7f34ba75694d req-eed063a6-fea0-4201-adff-e70cdad83a13 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438228
May 20 16:20:36.960618 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:20:36.967178 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1bd2de-7fa2-4573-92e9-a5d37ba25006 req-1713f023-77ee-48c8-90bb-a90985c8adbb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:36.968678 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c1bd2de-7fa2-4573-92e9-a5d37ba25006 req-1713f023-77ee-48c8-90bb-a90985c8adbb tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0870316
May 20 16:20:37.015381 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c1bd2de-7fa2-4573-92e9-a5d37ba25006 req-51c44202-b7e8-4858-a22a-90794ed5dcdd tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409541
May 20 16:20:37.527799 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba831065-caa3-4667-9095-c5b485a85f0f req-9e5cb73a-eb98-45b8-9b7c-41ef2abf3e4b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=bae1254f-ade8-46a7-9be9-068ba9e9d258 HTTP/1.1" status: 200  len: 210 time: 0.0448909
May 20 16:20:37.862689 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899fcf24-34fb-4f19-8486-0f2b77c2b444 req-a2f5ebcf-bf74-4a41-b8e3-fd7715274458 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:37.864443 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-899fcf24-34fb-4f19-8486-0f2b77c2b444 req-a2f5ebcf-bf74-4a41-b8e3-fd7715274458 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.0887651
May 20 16:20:37.909614 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-899fcf24-34fb-4f19-8486-0f2b77c2b444 req-33c59630-d062-488c-a22b-04fe66eda63c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389373
May 20 16:20:38.207833 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d92b510-5960-4de8-87c9-4ba1f0dca723 req-c25e68bb-9d03-4196-b96a-e5951751d7a2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:38.209353 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d92b510-5960-4de8-87c9-4ba1f0dca723 req-c25e68bb-9d03-4196-b96a-e5951751d7a2 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.0891721
May 20 16:20:38.255452 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d92b510-5960-4de8-87c9-4ba1f0dca723 req-78e720e1-51e1-41b1-a727-35c621ea0d26 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397439
May 20 16:20:38.632165 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-443fda38-1a3d-4bab-994f-bff3f187392c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:38.633055 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-443fda38-1a3d-4bab-994f-bff3f187392c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Synchronizing usage tracker for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:20:38.723137 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-443fda38-1a3d-4bab-994f-bff3f187392c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Unset dirty status for tenant:11c3c5cf74b64f749939ab72b3ea04ce on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:20:38.724663 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-443fda38-1a3d-4bab-994f-bff3f187392c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1894562
May 20 16:20:38.872981 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Deleting port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:38.873324 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:39.093288 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] For port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:39.094123 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:39.113678 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6aed54-93ce-449c-ac50-cb896ef499fd req-db5ca304-5834-434b-bc3c-511a110583be tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:39.115243 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4f6aed54-93ce-449c-ac50-cb896ef499fd req-db5ca304-5834-434b-bc3c-511a110583be tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.0958450
May 20 16:20:39.169132 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4f6aed54-93ce-449c-ac50-cb896ef499fd req-f97a871a-b76b-460e-8fc5-89498f3022c8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466752
May 20 16:20:39.294114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Calling delete_port for 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:39.351487 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12beff70-6442-4356-943a-aac926b15b41 req-f9e88fcd-5426-441f-9a12-85d6106e4237 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:39.352352 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-12beff70-6442-4356-943a-aac926b15b41 req-f9e88fcd-5426-441f-9a12-85d6106e4237 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Synchronizing usage tracker for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:20:39.538976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-548b514f-5dd4-4f7d-91a2-b8b1bf761585 req-07f75b8f-dec2-43a4-811f-75e0e75b8d5a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:39.539628 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-12beff70-6442-4356-943a-aac926b15b41 req-f9e88fcd-5426-441f-9a12-85d6106e4237 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Unset dirty status for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:20:39.540502 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-548b514f-5dd4-4f7d-91a2-b8b1bf761585 req-07f75b8f-dec2-43a4-811f-75e0e75b8d5a tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 945 time: 0.1459639
May 20 16:20:39.540962 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-12beff70-6442-4356-943a-aac926b15b41 req-f9e88fcd-5426-441f-9a12-85d6106e4237 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.4340839
May 20 16:20:39.586443 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-548b514f-5dd4-4f7d-91a2-b8b1bf761585 req-a21e05da-3776-4a58-9443-1bf537884ad1 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/security-groups?id=fdc102a2-f6fe-4641-ba93-6568d053d288&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401132
May 20 16:20:39.657709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:39.671964 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:39.674458 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:39.718374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Pushing event deleted for resources: {'Port': ['ID=6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:39.726411 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:39.805036 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] No DVR routers for this DVR port 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:20:39.810106 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:39.812547 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'name': 'network-vif-deleted', 'tag': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:39.831076 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Deleting port 5948d4d9-4307-4294-a458-260cc0b0d3d4 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:39.831450 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:39.862115 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6fd95e97-8d23-4aa4-ac1e-db147d7e371d', 'name': 'network-vif-deleted', 'tag': '6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0', 'status': 'completed', 'code': 200}
May 20 16:20:39.948514 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1172de1b-fd08-4a3c-981a-90af1abc38fa req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.16 "DELETE /v2.0/ports/6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 HTTP/1.1" status: 204  len: 173 time: 1.2149806
May 20 16:20:39.957997 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 82c98f0c-1ea5-462d-9be5-cd913e8b063c no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:39.973320 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] For port 5948d4d9-4307-4294-a458-260cc0b0d3d4, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5948d4d9-4307-4294-a458-260cc0b0d3d4,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:39.973588 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:39.992915 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 82c98f0c-1ea5-462d-9be5-cd913e8b063c {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:39.994605 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 82c98f0c-1ea5-462d-9be5-cd913e8b063c not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:40.108263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Calling delete_port for 5948d4d9-4307-4294-a458-260cc0b0d3d4 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:40.365636 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f5e77ad-3be7-4170-8697-1d3853bba1f0 req-34fc29f0-f25f-4726-abae-886ac127c9bf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:40.367134 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f5e77ad-3be7-4170-8697-1d3853bba1f0 req-34fc29f0-f25f-4726-abae-886ac127c9bf tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 945 time: 0.0850406
May 20 16:20:40.378153 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:40.390817 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ca3e4af4-d65f-4d9e-a220-2908a24d654d tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:40.423384 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f5e77ad-3be7-4170-8697-1d3853bba1f0 req-592e1e54-106a-4112-9539-b7ceab3fcf02 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0495358
May 20 16:20:40.466717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event deleted for resources: {'Port': ['ID=5948d4d9-4307-4294-a458-260cc0b0d3d4,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:40.476451 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:40.518014 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] No DVR routers for this DVR port 5948d4d9-4307-4294-a458-260cc0b0d3d4 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:20:40.520457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:40.605295 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-12beff70-6442-4356-943a-aac926b15b41 req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "DELETE /v2.0/ports/5948d4d9-4307-4294-a458-260cc0b0d3d4 HTTP/1.1" status: 204  len: 173 time: 1.0574260
May 20 16:20:40.755989 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-712e504a-da2a-4093-b898-dd7649fb1698 req-dd6bc77b-52ad-4ec9-b525-7931bc1b6ecf tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0443749
May 20 16:20:41.580731 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aae12287-c8ff-4553-8f1a-99df031f508b req-029a7da1-d19e-46b9-8f8b-f729e3238d7d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0419378
May 20 16:20:41.863848 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40273433-6605-47d8-b622-2f20548a035e', 'name': 'network-vif-deleted', 'tag': '5948d4d9-4307-4294-a458-260cc0b0d3d4'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:41.923693 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-875904cb-7095-4c10-973d-ec2696e8b3dd req-31538cdd-afe2-4914-9cbc-0e573a2f0cbf tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0462179
May 20 16:20:41.983596 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40273433-6605-47d8-b622-2f20548a035e', 'name': 'network-vif-deleted', 'tag': '5948d4d9-4307-4294-a458-260cc0b0d3d4', 'status': 'completed', 'code': 200}
May 20 16:20:42.728304 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b3da589-f838-49f6-967d-7d7740cc2ff8 req-a577de05-b9f7-486d-8b33-a98fd9311d6f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0411024
May 20 16:20:43.091109 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a63a3ea9-6ce5-449d-8246-adf06031e565 req-d2b7e4d6-f348-45cf-a9f9-1c021b38a0b6 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0421212
May 20 16:20:43.880201 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6f69efc6-df29-4093-89ec-b527140b5f70 req-0697851d-0a39-4c56-bdf2-95cdb8e180d9 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0451791
May 20 16:20:44.240093 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f', 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', '5948d4d9-4307-4294-a458-260cc0b0d3d4'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:44.267119 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4cb2035-a999-4a79-b131-0f217893854d req-2ac0e027-5a47-4ac0-a4ee-a0c24cb8b74f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0516815
May 20 16:20:45.026785 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-97949bda-65e6-426b-99e6-9645f2329b52 req-6831a14a-952c-4efb-8ff8-8c5ac5201f78 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0420015
May 20 16:20:45.421283 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d88f3988-f5b2-4bfa-b1eb-33f4a2f6d919 req-cc382859-52df-44e6-86a6-2cc4dd8dcc17 tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0445213
May 20 16:20:45.888019 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-19ae12b6-3fc5-48a1-bae8-db6e36a49e44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:46.174300 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-046822a8-d2d3-4741-aa09-7a27f86bb201 req-ef8151bf-a210-403d-b237-6bac7be08445 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0419097
May 20 16:20:46.582616 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5b650972-d5d8-4159-a974-eb2ebc30f94c req-bf7fbe7a-e138-45c0-a18f-ef08d602f1ce tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0419762
May 20 16:20:46.974939 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:47.012026 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:47.012367 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6ef8b82e-fcbf-4ba5-9b9f-e94af3083cf0 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:47.348617 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e157e8af-0503-40a4-b720-3934b7409555 req-e097e370-f0d8-4148-8aa8-51fe4ac63dae tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0466294
May 20 16:20:47.754711 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1fc246c6-6e37-4206-a360-39a81eb37e3e req-c4a7dac5-9e4d-43c1-b3d5-7591cabf102c tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] 10.222.0.64 "GET /v2.0/ports?device_id=6fd95e97-8d23-4aa4-ac1e-db147d7e371d HTTP/1.1" status: 200  len: 210 time: 0.0420270
May 20 16:20:48.418212 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:48.517438 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-72c5f6c6-09be-4d6a-80f5-1838304c6dfc req-d070e4cf-8b4d-4f82-afe2-b3bc35b00055 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0421941
May 20 16:20:48.658057 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5a87ffca-5d0b-4c3b-899b-24d35263eb6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:48.848173 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34206) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:49.385140 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:49.585227 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:49.754404 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d19b1bde-6905-436e-9fe4-ca210338faa0 req-85ddecc4-4b28-4aa3-911c-85dd92e133ee tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0791254
May 20 16:20:49.906588 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Deleting port eb882c39-3476-427e-b28d-c519a5094ad2 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:49.906869 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:50.027701 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] For port eb882c39-3476-427e-b28d-c519a5094ad2, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=eb882c39-3476-427e-b28d-c519a5094ad2,segment=NetworkSegment(e795581d-abe8-47e4-ab5f-18a44335be8d),segment_id=e795581d-abe8-47e4-ab5f-18a44335be8d)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:50.028055 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:50.148773 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Calling delete_port for eb882c39-3476-427e-b28d-c519a5094ad2 owned by network:router_interface {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:50.573822 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:50.578087 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1bdf0c18-02e9-4a37-b7a5-5dd8b0342e3b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:50.621627 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Pushing event deleted for resources: {'Port': ['ID=eb882c39-3476-427e-b28d-c519a5094ad2,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:50.665995 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.666350 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.666699 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.667038 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.667406 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.667742 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.668072 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.668404 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.668731 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.669059 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.669384 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.669707 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:50.673044 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:51.008683 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-329e31b1-51d3-4d13-8c8f-e2fadb4c3885 req-2d1c6356-016b-4d14-9fcd-e72ee5172ac1 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0568502
May 20 16:20:51.020190 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:51.229374 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:51.385301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Router b95b2402-e3e5-4f97-b17f-55814f64b9e1 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:20:51.570383 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:20:51.578786 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] Sync routers for ids ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:20:51.582665 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] 10.222.0.64 "PUT /v2.0/routers/b95b2402-e3e5-4f97-b17f-55814f64b9e1/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7334504
May 20 16:20:51.585116 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34242) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:51.589751 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] Routers {'b95b2402-e3e5-4f97-b17f-55814f64b9e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:51.590353 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712cba580>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:51.763543 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks [] for router, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:51.771532 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] Set router b95b2402-e3e5-4f97-b17f-55814f64b9e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:51.940719 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:52.055572 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712cba580>, [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:20:50Z', 'revision_number': 5, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port': {'id': '453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:f2:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:52.059852 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] Checking router: b95b2402-e3e5-4f97-b17f-55814f64b9e1 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:20:52.062642 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Deleting port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:52.063147 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:52.069257 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] Routers {'b95b2402-e3e5-4f97-b17f-55814f64b9e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:20:52.069892 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712cba580>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:52.230726 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-400c7423-24a1-4b2b-bbf3-a72a3e18b09c req-5e158416-1423-4dde-b7b0-98a481ffdef5 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0718184
May 20 16:20:52.254782 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] Set router b95b2402-e3e5-4f97-b17f-55814f64b9e1 gateway port host: None {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:20:52.257995 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] For port 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:52.258412 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:52.359287 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712cba580>, [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:20:51Z', 'revision_number': 6, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port_host': None}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:52.368781 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f198883f-1029-4b12-b203-6b509081a7ba None None] The sync data for ids ['b95b2402-e3e5-4f97-b17f-55814f64b9e1'] in dv-cinder-689486-13-iscsi is: [{'id': 'b95b2402-e3e5-4f97-b17f-55814f64b9e1', 'name': 'tempest-ServerRescueNegativeTestJSON-1832289942-router', 'tenant_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:35Z', 'updated_at': '2021-05-20T16:20:51Z', 'revision_number': 6, 'project_id': '11c3c5cf74b64f749939ab72b3ea04ce', 'gw_port_host': None}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:20:52.486966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Calling delete_port for 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 owned by network:router_gateway {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:52.745094 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:52.745094 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:52.793143 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Pushing event deleted for resources: {'Port': ['ID=453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:52.830534 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:52.893188 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.064853 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.067063 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.242545 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.243096 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Fanout notify agent at l3_agent the message router_deleted on router b95b2402-e3e5-4f97-b17f-55814f64b9e1 {{(pid=92421) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:20:53.257742 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.265103 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] 10.222.0.64 "DELETE /v2.0/routers/b95b2402-e3e5-4f97-b17f-55814f64b9e1 HTTP/1.1" status: 204  len: 168 time: 1.6734874
May 20 16:20:53.265103 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34262) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:53.329465 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Deleting subnet a6f615bc-43ff-44ce-82a2-e2cbda58ee9e {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:20:53.332030 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.361307 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5948d4d9-4307-4294-a458-260cc0b0d3d4 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:53.418888 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 5948d4d9-4307-4294-a458-260cc0b0d3d4 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:53.419452 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5948d4d9-4307-4294-a458-260cc0b0d3d4 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:53.425582 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-db5a566b-0d36-4f42-85ff-7c9701369cf8 req-4818637d-9644-4dab-978a-039c2c4ec201 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=40273433-6605-47d8-b622-2f20548a035e HTTP/1.1" status: 200  len: 210 time: 0.0514963
May 20 16:20:53.448693 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.471341 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device eb882c39-3476-427e-b28d-c519a5094ad2 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:53.520413 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: eb882c39-3476-427e-b28d-c519a5094ad2 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:53.520781 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device eb882c39-3476-427e-b28d-c519a5094ad2 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:53.521542 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:20:53.531649 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.560756 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:20:53.561131 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 453aca63-9dc5-4f7b-9a29-7ba7bc1b06c4 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:20:53.910948 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.915793 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-b94fcf05-fe0e-4436-a263-1d425dd7fe69 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:53.961040 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:53.963496 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a6f615bc-43ff-44ce-82a2-e2cbda58ee9e,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:53.965669 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:53.969919 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-96067060-21b0-45aa-bac8-36e240818286 admin admin] 10.222.0.64 "DELETE /v2.0/subnets/a6f615bc-43ff-44ce-82a2-e2cbda58ee9e HTTP/1.1" status: 204  len: 168 time: 0.7068961
May 20 16:20:53.972355 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34276) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:54.077665 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:54.201067 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:54.213474 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe71107dfa0>,) {'filters': {'network_id': ['6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:54.225249 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71107dfa0>, 'e795581d-abe8-47e4-ab5f-18a44335be8d') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:54.225531 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71107dfa0>, 'e795581d-abe8-47e4-ab5f-18a44335be8d') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:20:54.237429 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:54.253993 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:54.260008 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Releasing vlan 622 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:20:54.260377 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:20:54.279100 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:20:54.537892 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:54.543453 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:54.546107 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-68bb4795-97b8-4d58-8591-730e511505b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:54.569157 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Pushing event deleted for resources: {'Network': ['ID=6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:54.571597 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:54.711709 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] 10.222.0.64 "DELETE /v2.0/networks/6c76371b-9f2e-4ffd-82ea-0b8ffef4e9e4 HTTP/1.1" status: 204  len: 168 time: 0.7383003
May 20 16:20:55.412132 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d34f5e-516a-45d6-acd6-181902adaccf req-022ec646-2291-4119-b1ee-fa9617afd464 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:55.413776 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d3d34f5e-516a-45d6-acd6-181902adaccf req-022ec646-2291-4119-b1ee-fa9617afd464 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 945 time: 0.0870574
May 20 16:20:55.465169 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d3d34f5e-516a-45d6-acd6-181902adaccf req-83a5b097-0fe5-46c6-8d1e-2c9d65e95943 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445342
May 20 16:20:55.524872 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 34306) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:55.609948 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a0911bc9-b013-4afd-8ed6-46570759bbdf admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=11c3c5cf74b64f749939ab72b3ea04ce&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0838346
May 20 16:20:55.612500 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 34312) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:55.674134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:55.702474 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:55.928485 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:55.933400 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b3e72f68-1d46-444f-861f-063cdd4ec09f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:55.945353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdc102a2-f6fe-4641-ba93-6568d053d288,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:55.953908 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:55.955030 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/fdc102a2-f6fe-4641-ba93-6568d053d288 HTTP/1.1" status: 204  len: 168 time: 0.3413901
May 20 16:20:55.956470 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.956723 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.957086 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.957444 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.957798 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.958150 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.958522 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.959431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.959431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.959602 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.959863 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.960204 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:20:55.964081 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:56.747678 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe64d00-abe3-46ff-b32f-144229c4c9b3 req-9cc6ebf9-f98e-4e3e-91d1-928e22949f61 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:56.749302 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dbe64d00-abe3-46ff-b32f-144229c4c9b3 req-9cc6ebf9-f98e-4e3e-91d1-928e22949f61 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 945 time: 0.1546209
May 20 16:20:56.821873 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dbe64d00-abe3-46ff-b32f-144229c4c9b3 req-13f467f4-ecdd-4d60-a4e0-026b10c3b01d tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0651898
May 20 16:20:56.934015 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-50195bad-6e53-45c9-ad9a-50b57a1ec1d8 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1191993
May 20 16:20:57.059830 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-7b6f152f-66d3-4c43-90a7-93938747833f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:57.061732 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-7b6f152f-66d3-4c43-90a7-93938747833f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1098 time: 0.0995126
May 20 16:20:57.241864 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-22df812e-43bf-4dfe-be3e-6421872d62f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:57.244022 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-22df812e-43bf-4dfe-be3e-6421872d62f9 service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1607039
May 20 16:20:57.461789 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-97101cf9-7d09-4b64-82ac-4318a57aa059 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 1000 time: 0.2051356
May 20 16:20:57.564391 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-80e84f79-b2c9-4da7-9c91-564b54e8e646 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:57.566421 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-80e84f79-b2c9-4da7-9c91-564b54e8e646 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0980797
May 20 16:20:57.626974 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34384) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:57.766983 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-e832c059-ce74-4679-bfc7-f028e2793770 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:57.768857 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-e832c059-ce74-4679-bfc7-f028e2793770 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1886175
May 20 16:20:57.829626 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1668747514-network', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:57.834978 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:57.839483 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Usage tracker for resource:network and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:57.842618 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:57.850335 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:57.903890 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-f0ed306d-c106-48b2-9584-255e47f30442 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:57.903890 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-f0ed306d-c106-48b2-9584-255e47f30442 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Synchronizing usage tracker for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:20:57.976989 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-e93196b1-0dc5-4368-89c8-73fd94f0e3b0 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1960533
May 20 16:20:57.993834 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Made reservation on behalf of d01080acc33f4e539e888ae8b7bf7710 for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:20:57.996560 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.016771 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.049101 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:58.055744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Usage tracker for resource:security_group_rule and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:58.059112 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:58.067045 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:58.087372 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-f0ed306d-c106-48b2-9584-255e47f30442 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Unset dirty status for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:20:58.088607 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-f0ed306d-c106-48b2-9584-255e47f30442 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 945 time: 0.4022880
May 20 16:20:58.112392 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab87898-e36c-4a78-a96e-7f372dd6201a req-55279419-3d63-46f8-a70a-28bbba4b0785 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:58.121031 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ab87898-e36c-4a78-a96e-7f372dd6201a req-55279419-3d63-46f8-a70a-28bbba4b0785 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 945 time: 0.1694272
May 20 16:20:58.187007 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ab87898-e36c-4a78-a96e-7f372dd6201a req-8f8f13d8-dbd6-4bde-8f0a-dde3f2f886bb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0625834
May 20 16:20:58.267144 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.283657 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c3969d6-40ef-4b9e-90e4-78e51daee9aa req-3b7313f8-a662-40a6-93e5-3292d301bcfe service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2976241
May 20 16:20:58.394693 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Deleting port aa3b98da-a0e8-4ea3-81bb-be3921b39120 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:20:58.395035 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.444277 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.444277 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-016ca473-72a8-45d9-9456-25881740c0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:58.458350 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] vlan segment allocate from pool success with {'vlan_id': 645, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:20:58.471675 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9aafd63-8547-4b94-abd9-4a26c0716948,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:58.487318 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:58.491942 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.494352 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Added segment 785db113-1101-4c8c-b7d8-797ca01e729a of type vlan for network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc
May 20 16:20:58.526560 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.614370 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] For port aa3b98da-a0e8-4ea3-81bb-be3921b39120, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=aa3b98da-a0e8-4ea3-81bb-be3921b39120,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:20:58.627473 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.728661 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.791032 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Calling delete_port for aa3b98da-a0e8-4ea3-81bb-be3921b39120 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:20:58.859580 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.860970 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:20:58.862023 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:58.867939 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-731a2d28-9b84-461e-9d97-7120e4a389f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:58.971004 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Pushing event updated for resources: {'Network': ['ID=27fc1d30-3be1-47fb-bb79-13211cc6a4bc,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:58.973689 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:58.981441 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:20:59.024262 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:59.030718 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d6848e35-1a7a-4b1d-8360-a6573e6870bd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:59.078939 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event deleted for resources: {'Port': ['ID=aa3b98da-a0e8-4ea3-81bb-be3921b39120,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:59.085172 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.4554596
May 20 16:20:59.085172 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34404) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:20:59.091737 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Request body: {'subnet': {'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1668747514-subnet', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:20:59.101908 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:20:59.107765 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Usage tracker for resource:subnet and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:20:59.109857 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:20:59.113523 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:59.117296 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:20:59.154196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] No DVR routers for this DVR port aa3b98da-a0e8-4ea3-81bb-be3921b39120 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:20:59.156993 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:59.159738 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'name': 'network-vif-deleted', 'tag': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:20:59.194883 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Made reservation on behalf of d01080acc33f4e539e888ae8b7bf7710 for: {'subnet': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:20:59.197417 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6029181'] for subnet, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:59.214416 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd1d8d0de-b6c1-4f8e-8fed-a4e514607136', 'name': 'network-vif-deleted', 'tag': 'aa3b98da-a0e8-4ea3-81bb-be3921b39120', 'status': 'completed', 'code': 200}
May 20 16:20:59.226120 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-4cf692af-872c-41ff-90a2-b4a0fa0bc244 req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "DELETE /v2.0/ports/aa3b98da-a0e8-4ea3-81bb-be3921b39120 HTTP/1.1" status: 204  len: 173 time: 1.1241748
May 20 16:20:59.257795 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f', 'aa3b98da-a0e8-4ea3-81bb-be3921b39120'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:20:59.353469 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0179c1ba-51df-4357-abc8-fa020fc8b5f3 req-dc825f53-1be1-4c98-95ec-27923cafd82e tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0501299
May 20 16:20:59.752948 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6100820', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6029167'] for subnet, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:20:59.757387 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:20:59.834306 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0920934c-dffc-4a63-a7b4-a241d1aa9eb3,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:20:59.838940 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:20:59.843209 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Checking segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:20:59.843592 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Network hostable DHCP agents. Network: 27fc1d30-3be1-47fb-bb79-13211cc6a4bc, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92421) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:21:00.047839 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92421) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:21:00.225128 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 27fc1d30-3be1-47fb-bb79-13211cc6a4bc) {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:00.234832 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82ade734-642c-4d57-a552-fa6b07301b22 None None] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:21:00.237397 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:00.237397 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.327078 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-aff5202a-d375-42b1-8f01-e95be6515961 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.2408557
May 20 16:21:00.329543 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34420) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:00.334463 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:00.339696 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:00.343735 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Usage tracker for resource:router and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:00.346604 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:00.352546 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:00.436924 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.438187 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.455841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.457311 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:21:00.458085 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.522557 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d58fb85a-44b2-4f5a-8fe6-650ce585c6f9 req-e94b32b6-64b2-4b5e-9a46-3d7c7feafc61 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0480714
May 20 16:21:00.613162 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Allocated IP 172.20.0.2 (27fc1d30-3be1-47fb-bb79-13211cc6a4bc/0920934c-dffc-4a63-a7b4-a241d1aa9eb3/548c0205-ec17-4f3a-8eed-d4b388ae8c28) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:00.845900 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.857196 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Transition to ACTIVE for port object 548c0205-ec17-4f3a-8eed-d4b388ae8c28 will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:00.878284 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Transition to ACTIVE for port object 548c0205-ec17-4f3a-8eed-d4b388ae8c28 will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:00.967732 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.978317 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:00.983109 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:01.044204 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:01.047106 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:01.050866 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:01.085075 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Pushing event updated for resources: {'Port': ['ID=548c0205-ec17-4f3a-8eed-d4b388ae8c28,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:01.092548 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:01.146274 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Attempting to bind port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:21:01.146562 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Attempting to bind port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:21:01.146925 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Attempting to bind port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:01.152072 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 20, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:21:01.152448 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Checking segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:21:01.152858 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:01.153251 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Bound using segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:21:01.153714 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Bound port: 548c0205-ec17-4f3a-8eed-d4b388ae8c28, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:21:01.154094 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:01.246465 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] For port 548c0205-ec17-4f3a-8eed-d4b388ae8c28, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:21:01.249700 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] For port 548c0205-ec17-4f3a-8eed-d4b388ae8c28, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=548c0205-ec17-4f3a-8eed-d4b388ae8c28,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:21:01.372485 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:01.376272 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-8b34c1e2-fbfe-43ad-bc22-a167e8093dca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:01.455886 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Pushing event updated for resources: {'Port': ['ID=548c0205-ec17-4f3a-8eed-d4b388ae8c28,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:01.468924 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:01.482410 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:01.516131 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:01.747070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24b587d3-ce64-4f1d-a83f-064f16d12fa0 req-8f5ef6f1-dd00-4518-9644-03033ab2849f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0504336
May 20 16:21:01.756308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Allocated IP 172.27.0.127 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/61bee453-0d41-4f2d-ba44-53e5f933c0ff) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:01.906497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:02.037122 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:02.041759 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-29ec0245-ab4e-466e-92b5-2868c28d09b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:02.114658 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:02.118229 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:02.122449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:02.152016 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Pushing event updated for resources: {'Port': ['ID=61bee453-0d41-4f2d-ba44-53e5f933c0ff,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:02.159587 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:02.335234 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d8d90c6-3f02-4abd-8c38-cf39ea100845 None None] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:21:02.574268 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-efbda346-2548-4a5b-98c4-706f5597c9d2 None None] Provisioning for port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:02.720918 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:03.033479 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac3a7bb7-d930-4ae8-b928-036a7ec14343 req-30aac8ef-035a-45bf-b27a-c04d3a3e9191 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0652957
May 20 16:21:03.212743 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:03.469573 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 548c0205-ec17-4f3a-8eed-d4b388ae8c28 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:03.516052 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Router 27c15c4b-53de-4418-8ed7-78ad6d465033 is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92421) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:21:03.624557 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:03.629515 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:03.629893 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:03.691147 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:21:03.722756 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Sync routers for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:21:03.751267 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:21:03.751932 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712147130>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:03.784854 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:03.788632 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.4556379
May 20 16:21:03.788867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34456) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:03.823939 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:03.944688 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 548c0205-ec17-4f3a-8eed-d4b388ae8c28, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=548c0205-ec17-4f3a-8eed-d4b388ae8c28,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:03.962365 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:21:04.069564 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:04.071593 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:04.224004 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=548c0205-ec17-4f3a-8eed-d4b388ae8c28,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:04.229420 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:04.242906 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-afefafab-03fa-4995-9e45-452cf11c0af3 req-81ea4d2a-f54b-43e1-a53f-fa427dddb589 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0582836
May 20 16:21:04.359837 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712147130>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:02Z', 'revision_number': 3, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:04.364025 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Checking router: 27c15c4b-53de-4418-8ed7-78ad6d465033 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:21:04.364380 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Updating router 27c15c4b-53de-4418-8ed7-78ad6d465033 port 61bee453-0d41-4f2d-ba44-53e5f933c0ff binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:21:04.420415 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:04.625983 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:04.757014 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:04.769561 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Transition to ACTIVE for port object 61bee453-0d41-4f2d-ba44-53e5f933c0ff will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:04.829412 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Allocated IP 172.20.0.1 (27fc1d30-3be1-47fb-bb79-13211cc6a4bc/0920934c-dffc-4a63-a7b4-a241d1aa9eb3/0c22d087-9163-4497-b56c-9fca902a4033) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:04.837029 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:04.841502 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:04.915392 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Attempting to bind port 61bee453-0d41-4f2d-ba44-53e5f933c0ff on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:21:04.915763 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Attempting to bind port 61bee453-0d41-4f2d-ba44-53e5f933c0ff by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:21:04.916139 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Attempting to bind port 61bee453-0d41-4f2d-ba44-53e5f933c0ff on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:04.919582 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908878de-fce2-4411-bfee-bd66828cde2f None None] Pushing event updated for resources: {'Port': ['ID=61bee453-0d41-4f2d-ba44-53e5f933c0ff,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:04.924509 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-908878de-fce2-4411-bfee-bd66828cde2f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:04.925281 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 20, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:21:04.925653 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:21:04.926506 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:04.926506 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:21:04.926887 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Bound port: 61bee453-0d41-4f2d-ba44-53e5f933c0ff, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:21:04.927305 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:04.989688 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.003738 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] For port 61bee453-0d41-4f2d-ba44-53e5f933c0ff, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:21:05.006150 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Transition to ACTIVE for port object 0c22d087-9163-4497-b56c-9fca902a4033 will not be triggered until provisioned by entity DHCP. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:05.006856 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] For port 61bee453-0d41-4f2d-ba44-53e5f933c0ff, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=61bee453-0d41-4f2d-ba44-53e5f933c0ff,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:21:05.134179 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.137818 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:05.156669 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.160841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:05.210113 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:21:05.210732 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712147130>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:05.229716 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:05.232716 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:05.235759 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:05.276606 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908878de-fce2-4411-bfee-bd66828cde2f None None] Pushing event updated for resources: {'Port': ['ID=61bee453-0d41-4f2d-ba44-53e5f933c0ff,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:05.280985 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-908878de-fce2-4411-bfee-bd66828cde2f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:05.291144 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Pushing event updated for resources: {'Port': ['ID=0c22d087-9163-4497-b56c-9fca902a4033,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:05.294926 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:05.301951 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.441977 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:21:05.491101 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7e1a8e7a-1561-408a-abe7-acd2b39d066c req-609b0cf0-0b4d-45d4-ba4d-08996262f448 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.0696328
May 20 16:21:05.491457 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 548c0205-ec17-4f3a-8eed-d4b388ae8c28 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:05.715093 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.732117 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:05.732498 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.762496 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-c84b9939-619c-4d27-81e7-0d25447739f8 None None] Provisioning for port 0c22d087-9163-4497-b56c-9fca902a4033 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:05.808466 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-c84b9939-619c-4d27-81e7-0d25447739f8 None None] Provisioning complete for port 0c22d087-9163-4497-b56c-9fca902a4033 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:05.808848 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c84b9939-619c-4d27-81e7-0d25447739f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.892068 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-c84b9939-619c-4d27-81e7-0d25447739f8 None None] Port 0c22d087-9163-4497-b56c-9fca902a4033 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:21:05.947216 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:05.965922 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712147130>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:02Z', 'revision_number': 3, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:05.969966 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bc466d-b28e-4773-93b1-91d8c0cfcc33 None None] The sync data for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi is: [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:02Z', 'revision_number': 3, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:21:06.019685 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:06.046299 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-29628d56-5dc2-4cd2-97b9-23baa6fb8848 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:06.070906 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device aa3b98da-a0e8-4ea3-81bb-be3921b39120 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:21:06.121425 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: aa3b98da-a0e8-4ea3-81bb-be3921b39120 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:21:06.128842 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device aa3b98da-a0e8-4ea3-81bb-be3921b39120 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:21:06.154864 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:06.159449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Pushing event updated for resources: {'Port': ['ID=0c22d087-9163-4497-b56c-9fca902a4033,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:06.167543 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:06.417428 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:06.419029 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:06.836177 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-ddd58083-b637-4ecc-8e30-88bb1387a4c9 None None] Provisioning complete for port 0c22d087-9163-4497-b56c-9fca902a4033 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:06.836631 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ddd58083-b637-4ecc-8e30-88bb1387a4c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:06.984718 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-ddd58083-b637-4ecc-8e30-88bb1387a4c9 None None] Port 0c22d087-9163-4497-b56c-9fca902a4033 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:21:07.004069 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dd3ddb85-d4dc-437e-94f5-c082f24e3f46 req-58be9b3d-3b19-43ac-8863-4f25171ade13 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=d1d8d0de-b6c1-4f8e-8fed-a4e514607136 HTTP/1.1" status: 200  len: 210 time: 0.1154556
May 20 16:21:07.032394 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Router 27c15c4b-53de-4418-8ed7-78ad6d465033 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:21:07.331097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:21:07.352824 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] 10.222.0.64 "PUT /v2.0/routers/27c15c4b-53de-4418-8ed7-78ad6d465033/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.5628459
May 20 16:21:07.544898 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 61bee453-0d41-4f2d-ba44-53e5f933c0ff up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:07.714957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 61bee453-0d41-4f2d-ba44-53e5f933c0ff completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:07.720735 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 61bee453-0d41-4f2d-ba44-53e5f933c0ff triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:07.721135 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:08.023304 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:08.063089 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 61bee453-0d41-4f2d-ba44-53e5f933c0ff, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=61bee453-0d41-4f2d-ba44-53e5f933c0ff,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:08.251424 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:08.297262 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:08.503403 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34514) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:08.504803 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Sync routers for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:21:08.512351 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'security_group': {'name': 'tempest-securitygroup--241332625', 'description': 'tempest-description--2002937953'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:08.521901 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:08.527867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:08.530924 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:21:08.531632 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712e41c70>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:08.534104 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:08.543872 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:08.555948 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=61bee453-0d41-4f2d-ba44-53e5f933c0ff,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:08.567003 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:08.719088 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:08.792728 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:21:08.808064 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:08.816673 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group_rule and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:08.822729 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:08.838032 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:08.876867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529aceae-cad1-4105-a578-9cbab043a7cf req-2a2017ae-2c5f-456f-a2d2-afe9af4f488f tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:08.886312 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-2a2017ae-2c5f-456f-a2d2-afe9af4f488f tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/networks?id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca HTTP/1.1" status: 200  len: 813 time: 0.2199094
May 20 16:21:08.911479 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-ba632d15-0556-45a0-8fb2-9f65f790083e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/quotas/685f156c43064dcf8880e8af97070ea9 HTTP/1.1" status: 200  len: 375 time: 0.0240517
May 20 16:21:08.987968 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-a8c229f2-9be0-487f-bcd6-2d4012bfe4c6 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=685f156c43064dcf8880e8af97070ea9&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0752234
May 20 16:21:09.234405 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.238356 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-3b8eca5e-0d31-44fa-b841-95efc9334761 service neutron] 10.222.0.64 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2495992
May 20 16:21:09.254499 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712e41c70>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 2, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:09.279656 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Checking router: 27c15c4b-53de-4418-8ed7-78ad6d465033 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:21:09.279656 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Updating router 27c15c4b-53de-4418-8ed7-78ad6d465033 port 0c22d087-9163-4497-b56c-9fca902a4033 binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:21:09.359213 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.411765 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-93561577-9d60-4c7a-845c-a18a47ded3db service neutron] 10.222.0.64 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1665239
May 20 16:21:09.423569 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.428607 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-28d7a88b-1cc8-457f-9625-8fffbcfb40fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:09.466417 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 61bee453-0d41-4f2d-ba44-53e5f933c0ff up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:09.473991 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'SecurityGroup': ['ID=139f796a-28b7-43ee-8acc-f0f1e38ad622,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:09.481316 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:09.561161 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 61bee453-0d41-4f2d-ba44-53e5f933c0ff triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:09.561537 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.676333 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.678242 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 1.1732144
May 20 16:21:09.682011 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34550) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:09.687219 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'security_group_rule': {'security_group_id': '139f796a-28b7-43ee-8acc-f0f1e38ad622', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:09.695976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:09.700924 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group_rule and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:09.707987 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:09.719813 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:09.731278 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.746988 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Transition to ACTIVE for port object 0c22d087-9163-4497-b56c-9fca902a4033 will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:09.903955 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-000848e6-2348-4cf5-b00a-5b55b4041e3e req-db6774d1-9528-4c30-bba2-0ad26e0257b1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0605328
May 20 16:21:09.928578 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.937376 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:09.943356 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-d6ef9bb3-ab3f-4bd8-8c06-4f5deaebd7d5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:10.025628 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d8f06e5-f8b2-421e-95fb-8caef1daff9a None None] Pushing event updated for resources: {'Port': ['ID=0c22d087-9163-4497-b56c-9fca902a4033,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:10.092796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:10.315471 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:10.318522 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-74a72fe9-3e24-4737-a56e-ea9ec7468e2c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:10.397736 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Attempting to bind port 0c22d087-9163-4497-b56c-9fca902a4033 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:21:10.403771 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Attempting to bind port 0c22d087-9163-4497-b56c-9fca902a4033 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:21:10.403771 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Attempting to bind port 0c22d087-9163-4497-b56c-9fca902a4033 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:10.415581 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6d2f92ab-77ec-4a8d-ae1d-37095453ce2f,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:10.424440 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 20, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:21:10.425303 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Checking segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:21:10.425887 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:10.426434 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Bound using segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:21:10.429216 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Bound port: 0c22d087-9163-4497-b56c-9fca902a4033, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:21:10.429974 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:10.432660 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:10.461520 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-7d8f06e5-f8b2-421e-95fb-8caef1daff9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.516s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:10.540511 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] For port 0c22d087-9163-4497-b56c-9fca902a4033, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:21:10.543854 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] For port 0c22d087-9163-4497-b56c-9fca902a4033, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=0c22d087-9163-4497-b56c-9fca902a4033,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:21:10.583614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:10.584881 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.9019086
May 20 16:21:10.589143 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34582) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:10.596748 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'security_group_rule': {'security_group_id': '139f796a-28b7-43ee-8acc-f0f1e38ad622', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:10.606234 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:10.615643 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group_rule and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:10.620769 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:10.631405 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:10.666672 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:10.677851 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:10.759029 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:21:10.759746 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712e41c70>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:20:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:10.796498 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:10.929113 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d8f06e5-f8b2-421e-95fb-8caef1daff9a None None] Pushing event updated for resources: {'Port': ['ID=0c22d087-9163-4497-b56c-9fca902a4033,revision_number=4']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:10.932926 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-7d8f06e5-f8b2-421e-95fb-8caef1daff9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:10.936124 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:11.078657 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:21:11.104660 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:11.109781 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:11.153276 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d41ae6d8-e0f5-4fc4-9edf-d242e3d95518,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:11.158936 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:11.263887 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b3c81ed4-a471-49fc-bf0e-c8a7016ec48e req-28c051bc-6a0a-4af4-a0d6-3dc0f9fb212a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0569708
May 20 16:21:11.283854 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:11.288284 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-f14f2ee7-ebd8-47bd-8b51-6132ac7866f6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.6950479
May 20 16:21:11.297843 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34606) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:11.323264 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:11.328699 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:11.333906 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:floatingip and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:11.337877 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:11.345063 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:11.453611 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:11.686458 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712e41c70>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:10Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:11.691554 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd2985cf-bf39-435f-b869-9e0aea995e79 None None] The sync data for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi is: [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:10Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:21:11.876965 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb95f44b-6a6b-45bc-a9c5-13d471f6909a req-c96c2121-f7a5-4ce7-8888-d560f9243542 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:11.888167 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb95f44b-6a6b-45bc-a9c5-13d471f6909a req-c96c2121-f7a5-4ce7-8888-d560f9243542 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.3954751
May 20 16:21:11.953156 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfe4fae2-41bb-4a4b-923b-84ec3358f67a req-97954f60-8068-49a6-a4b8-3e0e3f1c22f7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:11.955036 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dfe4fae2-41bb-4a4b-923b-84ec3358f67a req-97954f60-8068-49a6-a4b8-3e0e3f1c22f7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.3628705
May 20 16:21:12.043529 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb95f44b-6a6b-45bc-a9c5-13d471f6909a req-53671277-ffac-4635-a861-e36da66058fb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1471152
May 20 16:21:12.065062 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:12.402905 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dfe4fae2-41bb-4a4b-923b-84ec3358f67a req-a9dfb9f9-4145-4263-a584-d37880c6b69c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.4341323
May 20 16:21:12.519529 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ffbec66c-6131-42aa-ba31-f0770b7b54f2 req-44cd4079-9a51-498f-a0e3-9a72672606dc tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0573606
May 20 16:21:12.570519 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Allocated IP 172.27.0.211 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/9a300ad5-f9a2-4002-801e-7e50b95ed4fe) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:12.779514 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:12.935504 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:12.940968 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a430eae9-afef-4297-b0d6-3b093ef1fdee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:13.019882 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:13.023620 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:13.027625 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:13.103024 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'Port': ['ID=9a300ad5-f9a2-4002-801e-7e50b95ed4fe,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:13.148183 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:13.180609 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:13.294883 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529aceae-cad1-4105-a578-9cbab043a7cf req-ea13c214-db89-4e8d-b8d0-cd674db0be6b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:13.303009 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-ea13c214-db89-4e8d-b8d0-cd674db0be6b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "GET /v2.0/networks?id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca HTTP/1.1" status: 200  len: 813 time: 0.2931702
May 20 16:21:13.313441 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Request body: {'port': {'device_id': '94758bc3-9989-4360-b228-8f3243a7f897', 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca', 'admin_state_up': True, 'tenant_id': '685f156c43064dcf8880e8af97070ea9'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:13.387573 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:13.472228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce82287-8b3e-4cd2-b2eb-10a137cc03c1 req-5069b062-098e-494f-a4dd-c8105e628d87 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:13.474173 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ce82287-8b3e-4cd2-b2eb-10a137cc03c1 req-5069b062-098e-494f-a4dd-c8105e628d87 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.2405329
May 20 16:21:13.570841 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 0c22d087-9163-4497-b56c-9fca902a4033 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:13.669892 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:13.679575 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Usage tracker for resource:port and tenant:685f156c43064dcf8880e8af97070ea9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:13.682621 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:13.689228 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:13.730855 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ce82287-8b3e-4cd2-b2eb-10a137cc03c1 req-2ec266db-fc05-423c-9b81-84f368efd3c7 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2372096
May 20 16:21:13.812306 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Made reservation on behalf of 685f156c43064dcf8880e8af97070ea9 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:21:13.817728 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:13.887557 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3db63c-cbe2-4ea6-851b-469643ce6b02 req-630eb6c3-3149-468a-b401-3a9725d5464c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:13.896950 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b3db63c-cbe2-4ea6-851b-469643ce6b02 req-630eb6c3-3149-468a-b401-3a9725d5464c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.3306344
May 20 16:21:13.966969 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 0c22d087-9163-4497-b56c-9fca902a4033 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:13.968960 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:21:13.978372 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 0c22d087-9163-4497-b56c-9fca902a4033 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:13.979116 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.003459 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-661d67c3-77a7-494d-ba0f-5cdf21f38c2b req-3c92c7e1-a917-46a0-a64d-2173c80de9ef tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0793762
May 20 16:21:14.013781 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.040961 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b3db63c-cbe2-4ea6-851b-469643ce6b02 req-7868b857-fc91-4a28-bcec-d03e579c0c84 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1319413
May 20 16:21:14.220788 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.226178 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:14.230662 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-0db5624c-dd9b-46c8-83d7-00ecfc36bbad tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:14.232758 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.232875 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-0db5624c-dd9b-46c8-83d7-00ecfc36bbad tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Synchronizing usage tracker for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:21:14.303542 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 0c22d087-9163-4497-b56c-9fca902a4033, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=0c22d087-9163-4497-b56c-9fca902a4033,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:14.323307 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Allocated IP 172.20.0.9 (3b4ff6d7-4fdf-4a00-84ee-540ff69761ca/a138ecac-0095-4014-bd32-91dbb855f1d1/93300f34-e9fe-4747-86be-148f099b326d) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:14.350696 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'Port': ['ID=9a300ad5-f9a2-4002-801e-7e50b95ed4fe,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:14.355227 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:14.361836 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.453218 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.455037 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-908878de-fce2-4411-bfee-bd66828cde2f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:14.464706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-0db5624c-dd9b-46c8-83d7-00ecfc36bbad tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Unset dirty status for tenant:747fc4332771467fa24e6bc07899b54f on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:21:14.465834 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-0db5624c-dd9b-46c8-83d7-00ecfc36bbad tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.3868568
May 20 16:21:14.522109 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=0c22d087-9163-4497-b56c-9fca902a4033,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:14.534762 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:14.621033 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.647233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.649580 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.3507111
May 20 16:21:14.728887 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Deleting port 4b373943-e984-4276-9601-6ed0d000265f {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:21:14.729243 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.826502 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:14.878019 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:15.037661 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:15.039059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:15.045190 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-36b3ed24-752f-4a20-905b-a28c1a8a2278 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Synchronizing usage tracker for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:security_group {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:21:15.051105 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:15.088028 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a51fe10-4b27-4c3f-9830-75d5da8dde10 req-889d91dd-633f-4022-93fc-745f66a97850 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:15.093305 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Pushing event updated for resources: {'Port': ['ID=93300f34-e9fe-4747-86be-148f099b326d,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:15.095711 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9a51fe10-4b27-4c3f-9830-75d5da8dde10 req-889d91dd-633f-4022-93fc-745f66a97850 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 946 time: 0.1620207
May 20 16:21:15.106787 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:15.144404 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:15.145101 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:15.152694 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9a51fe10-4b27-4c3f-9830-75d5da8dde10 req-19bc5cdb-e782-466c-9ad0-98815befffeb tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/security-groups?id=c7a57052-8dc4-4a60-80b0-5e9b0480dff5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0559132
May 20 16:21:15.159595 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] For port 4b373943-e984-4276-9601-6ed0d000265f, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4b373943-e984-4276-9601-6ed0d000265f,segment=NetworkSegment(6b15b2ba-0475-4448-8bb1-4db4352f2b43),segment_id=6b15b2ba-0475-4448-8bb1-4db4352f2b43)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:15.159955 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:15.184242 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-36b3ed24-752f-4a20-905b-a28c1a8a2278 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Unset dirty status for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:security_group {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:21:15.185692 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-36b3ed24-752f-4a20-905b-a28c1a8a2278 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-securitygroup--241332625&fields=id&tenant_id=d01080acc33f4e539e888ae8b7bf7710 HTTP/1.1" status: 200  len: 267 time: 0.2976120
May 20 16:21:15.312570 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Calling delete_port for 4b373943-e984-4276-9601-6ed0d000265f owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:21:15.431565 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.1223338
May 20 16:21:15.445734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Request body: {'port': {'device_id': '94758bc3-9989-4360-b228-8f3243a7f897', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:15.501697 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 0c22d087-9163-4497-b56c-9fca902a4033 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:15.546434 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-67bf1dbc-9528-4830-84ca-5ca439d6d170 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:15.547321 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-67bf1dbc-9528-4830-84ca-5ca439d6d170 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Synchronizing usage tracker for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:network {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:21:15.578484 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ce6b51-848c-4835-83d7-b5d13082a318 req-b5f72984-ecd7-426a-90cc-5d47c4f649a4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:15.587110 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c5ce6b51-848c-4835-83d7-b5d13082a318 req-b5f72984-ecd7-426a-90cc-5d47c4f649a4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1753619
May 20 16:21:15.614691 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:15.628879 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 0c22d087-9163-4497-b56c-9fca902a4033 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:15.629347 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:15.631676 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:15.635259 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c5ce6b51-848c-4835-83d7-b5d13082a318 req-db3c24ab-b317-41a8-8ddf-341c2052d65c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0463545
May 20 16:21:15.697759 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4b373943-e984-4276-9601-6ed0d000265f'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:21:15.700080 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Pushing event deleted for resources: {'Port': ['ID=4b373943-e984-4276-9601-6ed0d000265f,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:15.701712 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:15.733363 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-67bf1dbc-9528-4830-84ca-5ca439d6d170 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Unset dirty status for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:network {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:21:15.734822 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-67bf1dbc-9528-4830-84ca-5ca439d6d170 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 811 time: 0.5344272
May 20 16:21:15.740311 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:15.759821 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-ffa90fb1-764c-47f0-a36c-a36e9b01bb20 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/quotas/d01080acc33f4e539e888ae8b7bf7710 HTTP/1.1" status: 200  len: 375 time: 0.0115132
May 20 16:21:15.883883 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] No DVR routers for this DVR port 4b373943-e984-4276-9601-6ed0d000265f on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:21:15.903634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:15.925736 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'name': 'network-vif-deleted', 'tag': '4b373943-e984-4276-9601-6ed0d000265f'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:15.941125 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6a91c1a2-fdd5-408e-886c-5a2aa33b66b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:16.085775 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d325e197-6f53-4ea3-93de-cb07d258b631 req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.16 "DELETE /v2.0/ports/4b373943-e984-4276-9601-6ed0d000265f HTTP/1.1" status: 204  len: 173 time: 1.6101174
May 20 16:21:16.156560 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-3421ae73-cd67-44c9-8cd2-c678c841f300 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Synchronizing usage tracker for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:21:16.197689 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20ea8f11-8e23-41ee-9ed6-4091b5ac876a req-c85feff2-360d-45e2-a46d-1d29d204d82d tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:16.199255 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-20ea8f11-8e23-41ee-9ed6-4091b5ac876a req-c85feff2-360d-45e2-a46d-1d29d204d82d tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 931 time: 0.3240237
May 20 16:21:16.273331 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-3421ae73-cd67-44c9-8cd2-c678c841f300 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Unset dirty status for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:21:16.274734 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-3421ae73-cd67-44c9-8cd2-c678c841f300 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&fields=id HTTP/1.1" status: 200  len: 348 time: 0.5139525
May 20 16:21:16.296604 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-20ea8f11-8e23-41ee-9ed6-4091b5ac876a req-7b1faeb9-deb3-4294-b1bc-1c26af1b2fd5 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0822449
May 20 16:21:16.527914 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 93300f34-e9fe-4747-86be-148f099b326d {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:16.536615 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:16.554679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Transition to ACTIVE for port object 93300f34-e9fe-4747-86be-148f099b326d will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:16.554679 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '52d8f43c-5488-4a66-8dbc-952ba8495d4a', 'name': 'network-vif-deleted', 'tag': '4b373943-e984-4276-9601-6ed0d000265f', 'status': 'completed', 'code': 200}
May 20 16:21:16.676227 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:16.681353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:16.686032 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-144479ec-3779-4ce4-926f-da1a1b692793 service neutron] 10.222.0.64 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3708253
May 20 16:21:16.689012 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ce5b0c02-b64f-4868-b214-ef438186f2cf req-da248809-6254-4e89-aa08-b9643d78d07b tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.0704732
May 20 16:21:16.843299 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74199216-50f6-4672-aaab-b135013438ca service neutron] Pushing event updated for resources: {'Port': ['ID=93300f34-e9fe-4747-86be-148f099b326d,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:16.861351 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-74199216-50f6-4672-aaab-b135013438ca service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:16.955735 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Attempting to bind port 93300f34-e9fe-4747-86be-148f099b326d on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:21:16.956111 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Attempting to bind port 93300f34-e9fe-4747-86be-148f099b326d by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:21:16.956415 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Attempting to bind port 93300f34-e9fe-4747-86be-148f099b326d on network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:16.962363 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Port 93300f34-e9fe-4747-86be-148f099b326d on network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:21:16.978718 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Attempting to bind port 93300f34-e9fe-4747-86be-148f099b326d on network 3b4ff6d7-4fdf-4a00-84ee-540ff69761ca {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:16.978933 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-4c8c7f74-1e0b-4539-8320-dcbe39266ef4 service neutron] 10.222.0.64 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2723103
May 20 16:21:16.979158 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 20, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:21:16.979158 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Checking segment: {'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:21:16.979158 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Bound using segment: {'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:21:16.979158 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Bound port: 93300f34-e9fe-4747-86be-148f099b326d, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:21:16.979158 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:17.010704 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c717401-a2d5-408c-a57b-f54d3673ede5 req-7ea4e54b-2ac9-4006-87d8-0f0e96500b61 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:17.033567 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9c717401-a2d5-408c-a57b-f54d3673ede5 req-7ea4e54b-2ac9-4006-87d8-0f0e96500b61 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1677945
May 20 16:21:17.083398 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] For port 93300f34-e9fe-4747-86be-148f099b326d, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:21:17.087271 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] For port 93300f34-e9fe-4747-86be-148f099b326d, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=93300f34-e9fe-4747-86be-148f099b326d,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:21:17.146999 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9c717401-a2d5-408c-a57b-f54d3673ede5 req-7317261c-5e20-4742-83bc-09df809ece5c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1124139
May 20 16:21:17.226019 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:17.231165 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:17.304145 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:17.308996 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:17.308996 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-74199216-50f6-4672-aaab-b135013438ca service neutron] 10.222.0.16 "PUT /v2.0/ports/93300f34-e9fe-4747-86be-148f099b326d HTTP/1.1" status: 200  len: 1093 time: 1.8666031
May 20 16:21:17.363077 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74199216-50f6-4672-aaab-b135013438ca service neutron] Pushing event updated for resources: {'Port': ['ID=93300f34-e9fe-4747-86be-148f099b326d,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:17.370374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-74199216-50f6-4672-aaab-b135013438ca service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:17.446103 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-47c3c80c-4a7c-4831-91cc-1c96bcd875fc req-410ae27e-433d-4411-9239-413c8930042b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.0773530
May 20 16:21:17.631667 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ace1f9-fbc8-426e-8065-f6222aa9eb7e req-5f3c239b-7f5b-4231-b3ff-f81cb7b81b28 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:17.638674 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-05ace1f9-fbc8-426e-8065-f6222aa9eb7e req-5f3c239b-7f5b-4231-b3ff-f81cb7b81b28 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 943 time: 0.1457758
May 20 16:21:17.661688 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529aceae-cad1-4105-a578-9cbab043a7cf req-1adb326c-8a1a-4f8d-a6ff-57897039e461 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:17.663351 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-1adb326c-8a1a-4f8d-a6ff-57897039e461 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=685f156c43064dcf8880e8af97070ea9&device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 1096 time: 0.1423383
May 20 16:21:17.703711 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-05ace1f9-fbc8-426e-8065-f6222aa9eb7e req-f58cc9af-0151-406b-93b7-e08e4ee7f2a0 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0605087
May 20 16:21:17.820492 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-866feb7f-5370-4ff9-9b6a-7f011404b1dc service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=93300f34-e9fe-4747-86be-148f099b326d HTTP/1.1" status: 200  len: 217 time: 0.1458755
May 20 16:21:17.941708 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529aceae-cad1-4105-a578-9cbab043a7cf req-bb8eb8af-38a2-4f9c-960f-173fdb94e9da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:17.943306 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-bb8eb8af-38a2-4f9c-960f-173fdb94e9da service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a138ecac-0095-4014-bd32-91dbb855f1d1 HTTP/1.1" status: 200  len: 853 time: 0.1151271
May 20 16:21:17.950386 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-afda185e-68e2-4cd9-a2e5-09309e9df297 req-31aa2373-847c-4f40-b005-f9e6f3a42e67 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] 10.222.0.64 "GET /v2.0/ports?device_id=52d8f43c-5488-4a66-8dbc-952ba8495d4a HTTP/1.1" status: 200  len: 210 time: 0.0892348
May 20 16:21:18.013450 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-a367ec90-dc36-4e8d-a866-eab9a9044eba service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0612137
May 20 16:21:18.168343 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4b373943-e984-4276-9601-6ed0d000265f no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:21:18.182470 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-68cba53d-65f3-4405-8db6-9d8cb882bdae service neutron] 10.222.0.16 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1540985
May 20 16:21:18.262082 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 4b373943-e984-4276-9601-6ed0d000265f {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:21:18.262082 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4b373943-e984-4276-9601-6ed0d000265f not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:21:18.436996 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-529aceae-cad1-4105-a578-9cbab043a7cf req-3673fc06-0e71-49ac-948b-c8d93683bfe0 service neutron] 10.222.0.16 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2475479
May 20 16:21:18.470452 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92e3a9b-a173-42f8-b91b-ded810678dad req-aa175c48-4756-4baf-a7db-82732db357c6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:18.474317 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c92e3a9b-a173-42f8-b91b-ded810678dad req-aa175c48-4756-4baf-a7db-82732db357c6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1236708
May 20 16:21:18.494173 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:18.555762 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94758bc3-9989-4360-b228-8f3243a7f897', 'tag': '93300f34-e9fe-4747-86be-148f099b326d'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:18.592710 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-40d5773b-d0f1-45d3-a0a6-ed7695479268 req-bf60959a-d112-488d-94fd-34119de605dd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.0850990
May 20 16:21:18.602738 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c92e3a9b-a173-42f8-b91b-ded810678dad req-f870ad96-b873-4a86-a881-27dfc8033dea tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1219368
May 20 16:21:18.679694 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94758bc3-9989-4360-b228-8f3243a7f897', 'tag': '93300f34-e9fe-4747-86be-148f099b326d', 'status': 'completed', 'code': 200}
May 20 16:21:18.715618 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3c2668f0-92b3-42a2-9939-ed25038d3cc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:18.849389 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30100c3b-a89d-4796-9519-95f93497ec08 req-70f690e0-ed15-4d0e-b56e-120c2e3547da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:18.851250 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-30100c3b-a89d-4796-9519-95f93497ec08 req-70f690e0-ed15-4d0e-b56e-120c2e3547da service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=685f156c43064dcf8880e8af97070ea9&device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 1096 time: 0.1231985
May 20 16:21:18.955289 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ba1253-6f0a-4e22-8dd1-445c9bc120db req-a3e7ac27-5ef0-43b0-ae94-bd275c3e00a3 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:18.967124 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-65ba1253-6f0a-4e22-8dd1-445c9bc120db req-a3e7ac27-5ef0-43b0-ae94-bd275c3e00a3 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 943 time: 0.1313663
May 20 16:21:19.032082 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-65ba1253-6f0a-4e22-8dd1-445c9bc120db req-3c97fb24-70ba-4fc1-83de-5dacb461c21d tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0630047
May 20 16:21:19.079378 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34742) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:19.103697 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30100c3b-a89d-4796-9519-95f93497ec08 req-f685c6ca-0349-4700-9674-ffa2661736e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:19.105338 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-30100c3b-a89d-4796-9519-95f93497ec08 req-f685c6ca-0349-4700-9674-ffa2661736e5 service neutron] 10.222.0.16 "GET /v2.0/networks?id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca HTTP/1.1" status: 200  len: 914 time: 0.2410352
May 20 16:21:19.145410 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Deleting subnet 924a520e-53e5-4777-beb9-f9e6d0bd0dff {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:21:19.148858 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:19.177643 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-30100c3b-a89d-4796-9519-95f93497ec08 req-f44b2247-38a7-49b4-a9dc-7888eff7100c service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=93300f34-e9fe-4747-86be-148f099b326d HTTP/1.1" status: 200  len: 217 time: 0.0654368
May 20 16:21:19.201500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:19.251707 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30100c3b-a89d-4796-9519-95f93497ec08 req-49b3d2ac-2b27-4e4e-aafa-e5343ef36842 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:19.251707 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-30100c3b-a89d-4796-9519-95f93497ec08 req-49b3d2ac-2b27-4e4e-aafa-e5343ef36842 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=a138ecac-0095-4014-bd32-91dbb855f1d1 HTTP/1.1" status: 200  len: 853 time: 0.0649333
May 20 16:21:19.270291 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:19.303248 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-30100c3b-a89d-4796-9519-95f93497ec08 req-06c4ee25-d940-4971-aa8e-3966c8b13b22 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0464287
May 20 16:21:19.547434 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-30100c3b-a89d-4796-9519-95f93497ec08 req-5ca39c0a-fb29-4cda-ab68-bf755e2fd26a service neutron] 10.222.0.16 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2370965
May 20 16:21:19.708480 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-30100c3b-a89d-4796-9519-95f93497ec08 req-f6216f59-7498-4d29-99c5-5595ef92ba7f service neutron] 10.222.0.16 "GET /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1542459
May 20 16:21:19.722383 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:19.726870 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:19.729942 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-25a229af-3872-4783-b1b5-ded242951fb0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:19.894314 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=924a520e-53e5-4777-beb9-f9e6d0bd0dff,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:19.901867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:19.903296 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:19.907689 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4664cb7-aeee-4eca-9647-817f0a7793cf req-ed2a86b4-ebd2-49e0-b83e-8a53082a65b4 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.1208513
May 20 16:21:19.923273 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-94c52503-a192-4a1f-8acd-3f54053ab187 admin admin] 10.222.0.64 "DELETE /v2.0/subnets/924a520e-53e5-4777-beb9-f9e6d0bd0dff HTTP/1.1" status: 204  len: 168 time: 0.8403354
May 20 16:21:19.923620 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 34756) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:19.970791 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d654b1a7-c028-41df-bfae-fbfe654ae27a req-27ebba0a-4444-4769-9507-5107e78fc05d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:19.974382 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d654b1a7-c028-41df-bfae-fbfe654ae27a req-27ebba0a-4444-4769-9507-5107e78fc05d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1475530
May 20 16:21:20.070593 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:20.088420 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d654b1a7-c028-41df-bfae-fbfe654ae27a req-7b441b11-e4d3-4d61-b398-5b4649519312 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1077883
May 20 16:21:20.253320 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:20.280882 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe7115ba760>,) {'filters': {'network_id': ['7250e4c3-f4ff-4878-8316-65dfc0975bd3']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:20.305555 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7115ba760>, '6b15b2ba-0475-4448-8bb1-4db4352f2b43') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:20.306046 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7115ba760>, '6b15b2ba-0475-4448-8bb1-4db4352f2b43') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:20.328369 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:20.358313 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:20.368063 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Releasing vlan 608 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:21:20.368460 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:20.444271 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1daa0e5-6b50-47d0-9895-81fa3f7116c4 req-cae206ac-fba6-4f7f-bfbc-68f090faba0c tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:20.454633 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1daa0e5-6b50-47d0-9895-81fa3f7116c4 req-cae206ac-fba6-4f7f-bfbc-68f090faba0c tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 943 time: 0.2714281
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:21:20.516191 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:21:20.534074 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1daa0e5-6b50-47d0-9895-81fa3f7116c4 req-3c19424e-acb1-4a85-87dc-9af09af8de46 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0626967
May 20 16:21:20.624511 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:20.630777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e91e4466-eecb-4314-95f2-57fe86e041eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:20.655939 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:20.673383 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Pushing event deleted for resources: {'Network': ['ID=7250e4c3-f4ff-4878-8316-65dfc0975bd3,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:20.681294 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:20.769400 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-62261895-7427-42d7-a77c-afd3c5bb0438 admin admin] 10.222.0.64 "DELETE /v2.0/networks/7250e4c3-f4ff-4878-8316-65dfc0975bd3 HTTP/1.1" status: 204  len: 168 time: 0.8445354
May 20 16:21:21.111263 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d8800958-d253-4e06-9f65-99d06931e1f8 req-4cf5a5f5-9174-4465-9b2f-144a480abfbc tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.0549970
May 20 16:21:21.191577 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34786) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:21.276643 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:21.330871 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-23d04ac2-77b5-4ee0-b1f9-eee9e2d51bb2 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=747fc4332771467fa24e6bc07899b54f&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1339185
May 20 16:21:21.331982 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 34790) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:21.368119 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-058f3618-a2c1-4a8b-8ff1-addc3cba1f83 req-c5008583-ec15-40a8-8d67-89ddb09ebc9e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:21.369757 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-058f3618-a2c1-4a8b-8ff1-addc3cba1f83 req-c5008583-ec15-40a8-8d67-89ddb09ebc9e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1209719
May 20 16:21:21.421401 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:21.460057 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-058f3618-a2c1-4a8b-8ff1-addc3cba1f83 req-6d4ec7c3-e059-4e33-a6ad-8ddf314c6df1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0803430
May 20 16:21:21.480611 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:21.673593 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-c032bed9-814b-4384-ab02-883fc69c02bd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:21.676075 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-c032bed9-814b-4384-ab02-883fc69c02bd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 811 time: 0.2401204
May 20 16:21:21.721565 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:21.729310 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-13e39c31-d88f-4a41-9e0e-a55566687ffd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:21.751386 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7a57052-8dc4-4a60-80b0-5e9b0480dff5,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:21.778117 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:21.828872 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cc1cef-4d73-46bd-8517-e541ae834729 req-58baa957-c0ff-403e-a95c-07cab34ab813 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:21.830595 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98cc1cef-4d73-46bd-8517-e541ae834729 req-58baa957-c0ff-403e-a95c-07cab34ab813 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 943 time: 0.1632910
May 20 16:21:21.853190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:21.854379 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/c7a57052-8dc4-4a60-80b0-5e9b0480dff5 HTTP/1.1" status: 204  len: 168 time: 0.5210154
May 20 16:21:21.890595 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98cc1cef-4d73-46bd-8517-e541ae834729 req-a2527d90-9738-4e7a-9559-3ec6d6d970c4 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0537906
May 20 16:21:21.995696 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9690575f-e75d-465e-a0d2-fd777e1e1249 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Synchronizing usage tracker for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:security_group {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:21:22.150761 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9690575f-e75d-465e-a0d2-fd777e1e1249 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Unset dirty status for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:security_group {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:21:22.156019 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9690575f-e75d-465e-a0d2-fd777e1e1249 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-965044844&fields=id&tenant_id=b05498ab061b462e9f28e7d5e6bff55e HTTP/1.1" status: 200  len: 267 time: 0.2110846
May 20 16:21:22.392745 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-27926a56-e146-4663-9d92-6648a00f5d08 req-b3116405-9c59-447d-9c52-a1b4bd589d3e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.1329570
May 20 16:21:22.489639 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-14123057-bd6d-4e35-879a-f246d66555db tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:22.490562 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-14123057-bd6d-4e35-879a-f246d66555db tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Synchronizing usage tracker for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:network {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:21:22.567112 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-14123057-bd6d-4e35-879a-f246d66555db tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Unset dirty status for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:network {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:21:22.568495 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-14123057-bd6d-4e35-879a-f246d66555db tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 809 time: 0.4048095
May 20 16:21:22.596540 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9964c953-9607-4013-af21-d782e4172db7 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/quotas/b05498ab061b462e9f28e7d5e6bff55e HTTP/1.1" status: 200  len: 375 time: 0.0203652
May 20 16:21:22.768950 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bbb32df-7830-4437-9110-ef1b5e248c49 req-6ccc1d5e-75ce-445e-aece-cccd31fe2fad tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:22.770873 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6bbb32df-7830-4437-9110-ef1b5e248c49 req-6ccc1d5e-75ce-445e-aece-cccd31fe2fad tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1339791
May 20 16:21:22.797725 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-0b2f3e6c-f990-42b5-b9d0-b5476af536d1 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1912289
May 20 16:21:22.959548 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6bbb32df-7830-4437-9110-ef1b5e248c49 req-5ec6685e-1523-455a-8a9a-d6e2f3cfb37f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1359928
May 20 16:21:23.003935 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-b5d28dd2-65fc-476e-9648-34abd55d94c5 service neutron] 10.222.0.64 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1886773
May 20 16:21:23.197993 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-15cc8a42-d9a9-4b6d-b69b-a42252164d4c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d01080acc33f4e539e888ae8b7bf7710 HTTP/1.1" status: 200  len: 379 time: 0.0737691
May 20 16:21:23.266766 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9fb46153-7ec5-451a-b29e-84f475c8ed68 service neutron] 10.222.0.64 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2550230
May 20 16:21:23.282375 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a80211-6075-4f24-a2cb-30bb6477d52d req-1d7bd74c-2793-497d-8034-598476455cf3 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:23.283977 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03a80211-6075-4f24-a2cb-30bb6477d52d req-1d7bd74c-2793-497d-8034-598476455cf3 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 943 time: 0.1457608
May 20 16:21:23.343299 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03a80211-6075-4f24-a2cb-30bb6477d52d req-1a5304ce-0f9d-4c55-9d36-1a4bfecef8a8 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0529227
May 20 16:21:23.596874 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6bfc7fc0-4129-49cd-abb7-f0af2d74aa64 req-65baa7a6-5c09-46a5-9d87-ee81b92aaa89 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.0622108
May 20 16:21:23.991151 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2ddd1f1c-1114-441f-a4c6-3cc1b4e0ff10 req-601d4327-d8f2-418c-9360-5002a4a194a2 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 210 time: 0.0775650
May 20 16:21:24.169670 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'port': {'device_id': 'd419699d-6355-4177-82f9-39936e18d34c', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'admin_state_up': True, 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'security_groups': ['139f796a-28b7-43ee-8acc-f0f1e38ad622']}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:24.175528 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 93300f34-e9fe-4747-86be-148f099b326d details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:21:24.289550 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d6852e1-d524-4cba-bd05-899317d31691 req-7b84e974-83c3-45e8-9d97-6a0666f98540 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:24.300562 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3d6852e1-d524-4cba-bd05-899317d31691 req-7b84e974-83c3-45e8-9d97-6a0666f98540 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1927664
May 20 16:21:24.432166 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3d6852e1-d524-4cba-bd05-899317d31691 req-70474497-99d4-4844-9752-a52a80d898bd tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1291916
May 20 16:21:24.492023 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:24.517284 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:24.559468 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 93300f34-e9fe-4747-86be-148f099b326d, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=93300f34-e9fe-4747-86be-148f099b326d,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:24.582633 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '93300f34-e9fe-4747-86be-148f099b326d', 'network_id': '3b4ff6d7-4fdf-4a00-84ee-540ff69761ca', 'port_id': '93300f34-e9fe-4747-86be-148f099b326d', 'mac_address': 'fa:16:3e:b3:2a:f5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 639, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a138ecac-0095-4014-bd32-91dbb855f1d1', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:21:24.606844 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Made reservation on behalf of d01080acc33f4e539e888ae8b7bf7710 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:21:24.611486 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:24.666392 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:24.708538 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 93300f34-e9fe-4747-86be-148f099b326d {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:24.764560 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 93300f34-e9fe-4747-86be-148f099b326d, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=93300f34-e9fe-4747-86be-148f099b326d,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:24.804172 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b35458-72c2-49ae-9f5e-3091fa43f7de req-2ce1a38c-127d-4f90-82af-b66475fceea1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:24.805769 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f9b35458-72c2-49ae-9f5e-3091fa43f7de req-2ce1a38c-127d-4f90-82af-b66475fceea1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 943 time: 0.2329717
May 20 16:21:24.845452 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:24.847140 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-1baed4fb-18ee-4ae8-98c2-06f7ca5db9a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:24.922854 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ed790a50-fa7c-49d9-a706-dcc6f3146e37 req-c74a8eb0-8d89-4382-9182-4465ec2366fb tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.1158044
May 20 16:21:24.955623 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=93300f34-e9fe-4747-86be-148f099b326d,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:24.969168 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.972054 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.972598 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.972730 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f9b35458-72c2-49ae-9f5e-3091fa43f7de req-5c31b71b-bc6b-49e1-9482-9998651189b8 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0868411
May 20 16:21:24.973245 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.973614 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.973947 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.974265 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.977654 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.980970 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.980970 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.980970 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.980970 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:24.981317 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Allocated IP 172.20.0.7 (27fc1d30-3be1-47fb-bb79-13211cc6a4bc/0920934c-dffc-4a63-a7b4-a241d1aa9eb3/c643d109-2850-418c-806a-4eefcbdcc081) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:24.985377 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:25.109213 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-225f4b60-d5df-4958-bf2e-b89b7e2d9180 req-0ef4d20f-1b24-4274-924e-f31c89f22e78 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 210 time: 0.0512295
May 20 16:21:25.239825 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:25.265941 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Transition to ACTIVE for port object c643d109-2850-418c-806a-4eefcbdcc081 will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:25.368556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:25.388612 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7517dd05-1c67-4d4f-9f3b-3293de63e2af tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:25.473067 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:25.476860 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:25.480985 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:25.522154 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'Port': ['ID=c643d109-2850-418c-806a-4eefcbdcc081,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:25.539583 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:25.590600 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:25.598289 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:25.599291 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34904) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:25.693567 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5343330
May 20 16:21:25.782638 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Request body: {'port': {'device_id': 'd419699d-6355-4177-82f9-39936e18d34c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:25.865372 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0416e9-b327-46e4-8783-637b62a08768 req-f9a3edf2-3272-4334-abd5-0e165b6b6058 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:25.873702 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4d0416e9-b327-46e4-8783-637b62a08768 req-f9a3edf2-3272-4334-abd5-0e165b6b6058 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.2756224
May 20 16:21:25.921657 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-24b406a9-b080-48f1-8f9b-574ae7c3094f None None] Provisioning for port c643d109-2850-418c-806a-4eefcbdcc081 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:25.930587 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-24b406a9-b080-48f1-8f9b-574ae7c3094f None None] Provisioning complete for port c643d109-2850-418c-806a-4eefcbdcc081 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:25.931289 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-24b406a9-b080-48f1-8f9b-574ae7c3094f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:25.965725 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:25.977172 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4d0416e9-b327-46e4-8783-637b62a08768 req-9695beef-6baa-4f28-82e5-ffae2b0fb1aa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1020374
May 20 16:21:25.993273 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.033866 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-24b406a9-b080-48f1-8f9b-574ae7c3094f None None] Port c643d109-2850-418c-806a-4eefcbdcc081 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:21:26.039497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:26.058337 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Usage tracker for resource:security_group_rule and tenant:314c0634bf824324a25e7ca2d8b648f3 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:26.068345 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:26.090041 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:26.362879 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ab81cc-5300-482e-b800-607e34e0795b req-1b5d8343-00fd-48e9-bb97-78a3e8a229f7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:26.364380 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4ab81cc-5300-482e-b800-607e34e0795b req-1b5d8343-00fd-48e9-bb97-78a3e8a229f7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 931 time: 0.2802918
May 20 16:21:26.414784 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d46b2f-261e-496f-a740-f2de993e0826 req-d33c15ee-ee15-44ab-ac6f-c905d7748652 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:26.422177 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44d46b2f-261e-496f-a740-f2de993e0826 req-d33c15ee-ee15-44ab-ac6f-c905d7748652 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 944 time: 0.2656488
May 20 16:21:26.450012 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.490932 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4ab81cc-5300-482e-b800-607e34e0795b req-04e3006f-76d2-4edf-80ca-3a87a816d16c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1139901
May 20 16:21:26.508174 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44d46b2f-261e-496f-a740-f2de993e0826 req-8aede244-7217-4c64-82ef-8692f1bb22a2 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0834405
May 20 16:21:26.528417 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.541015 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-731f7fd8-1038-4608-967a-09638481768a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:26.605291 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=314c0634bf824324a25e7ca2d8b648f3&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0050092
May 20 16:21:26.607254 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a563ae0c-167f-4955-a99d-680a5b5f4a58,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:26.609841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34926) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:26.630866 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:26.663374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c643d109-2850-418c-806a-4eefcbdcc081 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:26.671400 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.691512 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Transition to ACTIVE for port object c643d109-2850-418c-806a-4eefcbdcc081 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:26.699784 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-765df124-92c4-4ceb-b0ae-5a9d34907234 req-b671f6c0-2fea-4987-8599-792ebe77387d tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 210 time: 0.0566483
May 20 16:21:26.734201 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['93300f34-e9fe-4747-86be-148f099b326d'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:21:26.751473 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.782913 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.807626 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.811780 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8ee56b80-0b36-4119-a417-4d0c20da74dd tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:26.955859 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:26.967857 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bd51ac7e-2a24-4e47-bbe6-c075444b9139 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:26.989698 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a563ae0c-167f-4955-a99d-680a5b5f4a58,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:26.998537 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:27.013903 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:27.030511 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/a563ae0c-167f-4955-a99d-680a5b5f4a58 HTTP/1.1" status: 204  len: 168 time: 0.4093196
May 20 16:21:27.134190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Pushing event updated for resources: {'Port': ['ID=c643d109-2850-418c-806a-4eefcbdcc081,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:27.137816 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:27.195741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Attempting to bind port c643d109-2850-418c-806a-4eefcbdcc081 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:21:27.196207 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Attempting to bind port c643d109-2850-418c-806a-4eefcbdcc081 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:21:27.196535 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Attempting to bind port c643d109-2850-418c-806a-4eefcbdcc081 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:27.204081 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Port c643d109-2850-418c-806a-4eefcbdcc081 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:21:27.204665 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Attempting to bind port c643d109-2850-418c-806a-4eefcbdcc081 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:27.217709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 20, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:21:27.218262 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Checking segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:21:27.218726 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Bound using segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:21:27.219476 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Bound port: c643d109-2850-418c-806a-4eefcbdcc081, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:21:27.220031 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:27.292050 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bb753e-0ef2-426c-8bf4-2c37df4f9b14 req-0705f041-343a-4b78-9ba8-c35c43089301 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:27.297501 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4bb753e-0ef2-426c-8bf4-2c37df4f9b14 req-0705f041-343a-4b78-9ba8-c35c43089301 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1039388
May 20 16:21:27.376164 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] For port c643d109-2850-418c-806a-4eefcbdcc081, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:21:27.380291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] For port c643d109-2850-418c-806a-4eefcbdcc081, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=c643d109-2850-418c-806a-4eefcbdcc081,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:21:27.393449 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4bb753e-0ef2-426c-8bf4-2c37df4f9b14 req-6044417c-a6ee-42c1-9ba0-4b1c64c64a64 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0758309
May 20 16:21:27.481756 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:27.487058 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-947d3b3a-2ca9-45e1-ba46-80a40e16bf31 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:27.549260 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:27.550128 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:27.552092 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] 10.222.0.16 "PUT /v2.0/ports/c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 1093 time: 1.7743006
May 20 16:21:27.564536 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:27.892063 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Pushing event updated for resources: {'Port': ['ID=c643d109-2850-418c-806a-4eefcbdcc081,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:27.896139 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.409s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:27.940824 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3ba899-b22b-4a95-b51f-f2723e7b5489 req-caafd192-aa1a-4b58-abf9-3a7a0349a21b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:27.942312 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0e3ba899-b22b-4a95-b51f-f2723e7b5489 req-caafd192-aa1a-4b58-abf9-3a7a0349a21b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 943 time: 0.2013793
May 20 16:21:27.951435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb98b2-db56-4121-883a-851e75a50dc5 req-85ac74b1-adaa-40c1-b9ef-1ece44c9281a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:27.952790 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bfb98b2-db56-4121-883a-851e75a50dc5 req-85ac74b1-adaa-40c1-b9ef-1ece44c9281a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 944 time: 0.1218529
May 20 16:21:28.028203 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-7495f464-a9f1-4213-9c57-cf51bc6ac73a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:28.038770 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-7495f464-a9f1-4213-9c57-cf51bc6ac73a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.16 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 809 time: 0.3931410
May 20 16:21:28.040261 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-7f87ec63-1495-419a-b1dd-37f1df4c8f2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:28.041749 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-7f87ec63-1495-419a-b1dd-37f1df4c8f2c service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1096 time: 0.2008471
May 20 16:21:28.070881 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0e3ba899-b22b-4a95-b51f-f2723e7b5489 req-1a251120-86e3-42fe-ac19-eca2c2d86bbb tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1171091
May 20 16:21:28.090859 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bfb98b2-db56-4121-883a-851e75a50dc5 req-2c6d603d-1c9a-4378-b574-ada1fb68d18a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1218624
May 20 16:21:28.145083 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-adb95164-b0da-4c97-9271-fd2d25d31759 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 217 time: 0.0844376
May 20 16:21:28.172497 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081', 'status': 'completed', 'code': 200}
May 20 16:21:28.191623 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 93300f34-e9fe-4747-86be-148f099b326d up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:28.223450 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-d2438c20-d4ff-4f96-86f6-9b83b010fc17 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b05498ab061b462e9f28e7d5e6bff55e HTTP/1.1" status: 200  len: 379 time: 0.1805968
May 20 16:21:28.237491 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'port': {'device_id': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'admin_state_up': True, 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'security_groups': ['af364d12-8f8f-41f5-b04f-0618bf1f0081']}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:28.330687 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a7f40dff-e773-4d8a-8037-559a19f76ef6 req-13fc8219-efa7-4ada-ab79-d4b6df514997 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 210 time: 0.0923622
May 20 16:21:28.423737 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34958) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:28.447326 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 93300f34-e9fe-4747-86be-148f099b326d completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:28.454481 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 93300f34-e9fe-4747-86be-148f099b326d triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:28.456398 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.475803 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.514161 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:28.520315 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:28.527528 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Usage tracker for resource:security_group_rule and tenant:ad611f6d060949509668d68bdf931d65 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:28.531881 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:28.540793 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:port and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:28.541394 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:28.547749 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-d72f4518-bcd1-436c-b803-3d04b5cdf3d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:28.549212 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-d72f4518-bcd1-436c-b803-3d04b5cdf3d3 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.3891060
May 20 16:21:28.550059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:28.647228 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:28.696826 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.710540 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.717215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7669bebd-d16d-48d6-9d79-f7e867b7ddfa req-1b3d6675-8e42-4414-83b8-9543da7cceaa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:28.718810 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7669bebd-d16d-48d6-9d79-f7e867b7ddfa req-1b3d6675-8e42-4414-83b8-9543da7cceaa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1289148
May 20 16:21:28.746798 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94758bc3-9989-4360-b228-8f3243a7f897', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '93300f34-e9fe-4747-86be-148f099b326d'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:28.751288 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-ea570102-482d-4e13-af27-d983c09ec379 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:28.758070 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-ea570102-482d-4e13-af27-d983c09ec379 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1959774
May 20 16:21:28.775746 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 93300f34-e9fe-4747-86be-148f099b326d, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=93300f34-e9fe-4747-86be-148f099b326d,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:28.799263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Made reservation on behalf of b05498ab061b462e9f28e7d5e6bff55e for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:21:28.802783 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.821450 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94758bc3-9989-4360-b228-8f3243a7f897', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '93300f34-e9fe-4747-86be-148f099b326d', 'code': 200}
May 20 16:21:28.830291 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.833086 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:28.846124 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.859524 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7669bebd-d16d-48d6-9d79-f7e867b7ddfa req-94b3f9ae-9b22-4083-9339-a2f0d111bd73 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1323035
May 20 16:21:28.950939 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=93300f34-e9fe-4747-86be-148f099b326d,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:28.956503 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:28.964175 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:28.969026 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-adf6f3ef-7c95-4004-b903-49841b9da43f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:29.026016 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d630df5f-22e4-40b6-af61-876a2f38d286,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:29.055623 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ad611f6d060949509668d68bdf931d65&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6303444
May 20 16:21:29.057219 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f83ed4ea-204f-4cd7-bc48-864df0dc681a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:29.058004 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 34970) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:29.135022 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ffb5c518-a118-44a9-b76c-bf520b6dc881 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:29.186009 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-26a01c6d-76df-4c09-86cf-5da4a733934b service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4185829
May 20 16:21:29.198379 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ffb5c518-a118-44a9-b76c-bf520b6dc881 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:29.432867 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Allocated IP 172.20.0.3 (39834042-f759-400b-9bc0-eb7c7abdd5c0/b5688f1d-b45f-4391-b845-213d900ae645/df15e363-aade-4bfb-9359-102c4aa7cae5) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:29.463936 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-60d98dbe-1afa-477c-bcd8-45942f01f3e9 req-7e39b158-b315-4d41-9dfe-e3ebb7276ddc service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2683811
May 20 16:21:29.554604 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301d395c-714b-4091-ab94-315738c05618 req-045c8334-9752-4d41-98ab-8f52705948b8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:29.556247 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301d395c-714b-4091-ab94-315738c05618 req-045c8334-9752-4d41-98ab-8f52705948b8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 943 time: 0.2614098
May 20 16:21:29.566511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13252cbc-c11b-4873-9b9d-ebe39c63617d req-e1b42789-c401-40d6-9a49-bbffb5a6ba70 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:29.568019 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-13252cbc-c11b-4873-9b9d-ebe39c63617d req-e1b42789-c401-40d6-9a49-bbffb5a6ba70 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 945 time: 0.2064638
May 20 16:21:29.589228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1981b71-6559-43bf-bf15-e76e4fdfdcd3 req-970cfc86-e862-47f9-8109-bc6385d25332 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:29.590661 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d1981b71-6559-43bf-bf15-e76e4fdfdcd3 req-970cfc86-e862-47f9-8109-bc6385d25332 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 1098 time: 0.2218647
May 20 16:21:29.644558 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ffb5c518-a118-44a9-b76c-bf520b6dc881 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:29.662124 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-90cd9b81-c02b-446d-9207-602190292a71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:29.720443 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d1981b71-6559-43bf-bf15-e76e4fdfdcd3 req-14d63ce3-7caa-439c-bcdf-eff6d6772030 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1085672
May 20 16:21:29.721454 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ffb5c518-a118-44a9-b76c-bf520b6dc881 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:29.725783 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-ffb5c518-a118-44a9-b76c-bf520b6dc881 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d630df5f-22e4-40b6-af61-876a2f38d286 HTTP/1.1" status: 204  len: 168 time: 0.6634982
May 20 16:21:29.725783 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb5c518-a118-44a9-b76c-bf520b6dc881 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d630df5f-22e4-40b6-af61-876a2f38d286,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:29.753461 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301d395c-714b-4091-ab94-315738c05618 req-8b19bdbb-cc16-49ae-88fa-2a0656dcdde9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1811554
May 20 16:21:29.753461 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ffb5c518-a118-44a9-b76c-bf520b6dc881 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:29.784096 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-13252cbc-c11b-4873-9b9d-ebe39c63617d req-f80505cb-1db7-49ca-b361-d812595f4b62 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1975265
May 20 16:21:29.850181 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:29.872663 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Transition to ACTIVE for port object df15e363-aade-4bfb-9359-102c4aa7cae5 will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:29.878931 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-0e00dfb0-3e1f-4f6b-a71a-2434b7daa73e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:29.880473 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-0e00dfb0-3e1f-4f6b-a71a-2434b7daa73e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1096 time: 0.2595246
May 20 16:21:30.003177 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c3f6509c-f159-4f86-98b4-a895daf9b2c9 req-b7976712-d434-46f6-b489-dfc3d0670869 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 210 time: 0.0963838
May 20 16:21:30.031092 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:30.040946 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd0502a4-dca0-46a9-8943-d50f66be63b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:30.117600 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:30.122741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:30.127145 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90209fa6-dc7e-4864-ae93-a9f9f2f29679 req-e52d9c40-c86e-426f-b011-3c1c27c93552 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:30.128710 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-90209fa6-dc7e-4864-ae93-a9f9f2f29679 req-e52d9c40-c86e-426f-b011-3c1c27c93552 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.0930552
May 20 16:21:30.129669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:30.202642 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-90209fa6-dc7e-4864-ae93-a9f9f2f29679 req-17ef671c-1bf6-4f0a-8418-bd4a4af3172a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0669842
May 20 16:21:30.218455 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:21:30.224959 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:30.261478 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:30.263697 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-9f9cd1bd-14d8-43c5-9a7c-49488e0cfe10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:30.266265 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-9f9cd1bd-14d8-43c5-9a7c-49488e0cfe10 service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.3661354
May 20 16:21:30.295924 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:30.296573 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:30.404530 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-3c1b1d4e-f784-4acb-979e-47a9e5fdf934 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 217 time: 0.1012251
May 20 16:21:30.425088 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:30.439021 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'port_id': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'mac_address': 'fa:16:3e:eb:92:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:21:30.481203 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-649ce56e-842f-4628-a84b-36046c461a69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:30.482630 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-649ce56e-842f-4628-a84b-36046c461a69 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.0719454
May 20 16:21:30.508245 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:30.525622 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4c1d2c1d-f53f-4921-822b-db24d856090e {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:30.527106 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.2957859
May 20 16:21:30.541852 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:30.548347 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Request body: {'port': {'device_id': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:30.642137 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-1ffc9e8b-ee7d-4768-bace-e25814d47edf None None] Provisioning for port df15e363-aade-4bfb-9359-102c4aa7cae5 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:30.647280 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:30.651264 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:30.665087 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-ac44e497-e19d-4a54-8d89-bbfa594cee86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:30.666652 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-ac44e497-e19d-4a54-8d89-bbfa594cee86 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1769128
May 20 16:21:30.689407 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-1ffc9e8b-ee7d-4768-bace-e25814d47edf None None] Provisioning complete for port df15e363-aade-4bfb-9359-102c4aa7cae5 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:30.689772 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-1ffc9e8b-ee7d-4768-bace-e25814d47edf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:30.699395 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:30.770182 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-1ffc9e8b-ee7d-4768-bace-e25814d47edf None None] Port df15e363-aade-4bfb-9359-102c4aa7cae5 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:21:30.777272 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=6']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:30.781593 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:30.914258 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-16e9c1e8-c760-44cb-b16c-1584b00cec6f service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2398303
May 20 16:21:31.033687 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4c1d2c1d-f53f-4921-822b-db24d856090e'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:21:31.110186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b412f199-a08c-4109-bece-171d6e99e79e req-aaa82753-9c22-4dc7-8a98-3dec0fd948f9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:31.111990 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b412f199-a08c-4109-bece-171d6e99e79e req-aaa82753-9c22-4dc7-8a98-3dec0fd948f9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 943 time: 0.2529354
May 20 16:21:31.146828 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8dd597-1828-4c10-9a25-66fd3adaf1bb req-60b184cc-bef8-410e-9a37-0e6a5c5cc33c tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:31.156273 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2b8dd597-1828-4c10-9a25-66fd3adaf1bb req-60b184cc-bef8-410e-9a37-0e6a5c5cc33c tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 945 time: 0.2515733
May 20 16:21:31.219790 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b412f199-a08c-4109-bece-171d6e99e79e req-66912b9c-47e8-428d-8b27-15095c1dd75d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0988629
May 20 16:21:31.242943 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2b8dd597-1828-4c10-9a25-66fd3adaf1bb req-a2ec65c1-9ed8-4f9b-a781-8537997bc426 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0820048
May 20 16:21:31.446150 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e2115bf4-8bc9-4f7e-939c-39e8b7b294ae req-dab92105-8f0e-4d2f-adb0-beb2c8fe98a7 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5213575
May 20 16:21:31.538055 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id df15e363-aade-4bfb-9359-102c4aa7cae5 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:31.545616 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:31.555267 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef03f6d-3d90-4bf3-a092-f83363907f57 req-b3adba83-ee15-4057-834e-a6066aa64b91 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:31.556617 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eef03f6d-3d90-4bf3-a092-f83363907f57 req-b3adba83-ee15-4057-834e-a6066aa64b91 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 931 time: 0.1745210
May 20 16:21:31.565262 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Transition to ACTIVE for port object df15e363-aade-4bfb-9359-102c4aa7cae5 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:31.569206 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab78691-d024-404e-86be-f73f94145a9c req-f11cb578-189f-40e9-9124-09c7b36e5056 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:31.571261 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ab78691-d024-404e-86be-f73f94145a9c req-f11cb578-189f-40e9-9124-09c7b36e5056 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 944 time: 0.1442065
May 20 16:21:31.638107 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eef03f6d-3d90-4bf3-a092-f83363907f57 req-51b93867-88cc-47e1-b9d7-7070aaaec0c3 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0658660
May 20 16:21:31.645505 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ab78691-d024-404e-86be-f73f94145a9c req-b19e0368-9da5-425e-a733-0ed637f2d4c0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0606401
May 20 16:21:31.665052 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:31.669982 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:31.868196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:31.889405 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:31.931750 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Attempting to bind port df15e363-aade-4bfb-9359-102c4aa7cae5 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:21:31.932122 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Attempting to bind port df15e363-aade-4bfb-9359-102c4aa7cae5 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:21:31.932438 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Attempting to bind port df15e363-aade-4bfb-9359-102c4aa7cae5 on network 39834042-f759-400b-9bc0-eb7c7abdd5c0 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:31.937853 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Port df15e363-aade-4bfb-9359-102c4aa7cae5 on network 39834042-f759-400b-9bc0-eb7c7abdd5c0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:21:31.938246 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Attempting to bind port df15e363-aade-4bfb-9359-102c4aa7cae5 on network 39834042-f759-400b-9bc0-eb7c7abdd5c0 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:31.944094 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 21, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:21:31.944442 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Checking segment: {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:21:31.945512 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Bound using segment: {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:21:31.946138 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Bound port: df15e363-aade-4bfb-9359-102c4aa7cae5, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '855ceff0-a862-4f90-88cc-63bc7047c2ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:21:31.946421 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:32.057947 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:21:32.061093 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:21:32.220321 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device c643d109-2850-418c-806a-4eefcbdcc081 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:21:32.223803 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:32.235846 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:32.236052 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-da3f3a51-ebf8-44b6-b102-e374ffa985e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:32.314774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:32.314774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:32.314774 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] 10.222.0.16 "PUT /v2.0/ports/df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 1093 time: 1.7693567
May 20 16:21:32.314774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:32.355755 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:32.375622 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:32.483442 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 4c1d2c1d-f53f-4921-822b-db24d856090e triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:32.494121 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:32.619496 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port c643d109-2850-418c-806a-4eefcbdcc081, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=c643d109-2850-418c-806a-4eefcbdcc081,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:32.624617 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba62cea5-f2d4-4de0-a47c-7fe4ebce0b4b req-28746af9-367f-456a-b827-2c3e769bee9c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:32.626175 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba62cea5-f2d4-4de0-a47c-7fe4ebce0b4b req-28746af9-367f-456a-b827-2c3e769bee9c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 943 time: 0.2050989
May 20 16:21:32.635862 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-88b840b0-dfac-4b37-9a63-a3bba4f43b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:32.638331 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-88b840b0-dfac-4b37-9a63-a3bba4f43b07 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1096 time: 0.1341555
May 20 16:21:32.708159 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59cd9a1-643a-40b6-9f88-496758f0a2a8 req-e5fe9748-c2b5-48bd-937f-0788296ca1a4 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:32.709174 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': 'c643d109-2850-418c-806a-4eefcbdcc081', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'port_id': 'c643d109-2850-418c-806a-4eefcbdcc081', 'mac_address': 'fa:16:3e:93:c3:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 645, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:21:32.710842 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b59cd9a1-643a-40b6-9f88-496758f0a2a8 req-e5fe9748-c2b5-48bd-937f-0788296ca1a4 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 945 time: 0.2524269
May 20 16:21:32.719258 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba62cea5-f2d4-4de0-a47c-7fe4ebce0b4b req-6ad40ee7-7410-44bd-a84a-9213037f2bde tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0823677
May 20 16:21:32.747667 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-32458aca-039d-45fe-9ebe-16b0822496ab service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 217 time: 0.0805581
May 20 16:21:32.795247 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:32.827836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:32.829082 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b59cd9a1-643a-40b6-9f88-496758f0a2a8 req-27ef15c5-41f1-48df-99b3-886c62498621 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1006761
May 20 16:21:32.842427 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'status': 'completed', 'code': 200}
May 20 16:21:32.870308 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:32.871613 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-ef5f7497-6422-4b1a-8c7d-9c9904734fce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:32.873303 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-ef5f7497-6422-4b1a-8c7d-9c9904734fce service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 200  len: 848 time: 0.1314921
May 20 16:21:32.877539 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c643d109-2850-418c-806a-4eefcbdcc081 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:32.887632 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:32.899620 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port c643d109-2850-418c-806a-4eefcbdcc081, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=c643d109-2850-418c-806a-4eefcbdcc081,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:32.982605 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-67697b19-8136-4f9e-8532-78a9e50a5410 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:32.982605 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-67697b19-8136-4f9e-8532-78a9e50a5410 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=39834042-f759-400b-9bc0-eb7c7abdd5c0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1011982
May 20 16:21:33.001717 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:33.011488 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:33.041363 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:33.093440 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=c643d109-2850-418c-806a-4eefcbdcc081,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:33.106945 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:33.107738 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.058s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:33.170033 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21885130-aa40-47b8-aa44-0f826009ed0b req-1984731f-8df5-43a7-a6a1-b26fa00c5f46 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:33.171585 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-b30108fa-f125-4414-a9f0-b6c401718720 service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1793156
May 20 16:21:33.177436 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-21885130-aa40-47b8-aa44-0f826009ed0b req-1984731f-8df5-43a7-a6a1-b26fa00c5f46 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1962705
May 20 16:21:33.187952 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef281cb-03a7-4e98-aba2-8c57cd2a745c req-d268f1e7-ace0-455b-af84-139e66906271 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:33.195600 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aef281cb-03a7-4e98-aba2-8c57cd2a745c req-d268f1e7-ace0-455b-af84-139e66906271 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.2581847
May 20 16:21:33.196869 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=7']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:33.200492 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:33.285068 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aef281cb-03a7-4e98-aba2-8c57cd2a745c req-d8724cba-6e4c-4d4d-af81-5a138e339ede tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0835569
May 20 16:21:33.292926 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-21885130-aa40-47b8-aa44-0f826009ed0b req-3911e3bc-64e5-4619-9a70-e98fd56612ea tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0950646
May 20 16:21:33.326660 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-3e90f222-55bc-47cd-a77c-d0c42869496d req-067ac221-8f69-4441-b927-90c47495707e service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1481135
May 20 16:21:33.344135 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'code': 200}
May 20 16:21:33.545346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-60645a7a-67a6-4994-b76e-e1d115998c6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:33.546893 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-60645a7a-67a6-4994-b76e-e1d115998c6f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1096 time: 0.0712481
May 20 16:21:33.689299 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-9c171bdc-315a-4d66-80d0-bb167d8960b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:33.691027 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-9c171bdc-315a-4d66-80d0-bb167d8960b0 service neutron] 10.222.0.16 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 910 time: 0.1362042
May 20 16:21:33.741098 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35144) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:33.764755 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-0906329c-aa1f-47d3-aa0b-cd24a02dd3e3 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 217 time: 0.0659811
May 20 16:21:33.859390 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-814b4d32-38cd-47f2-a39f-51f1d749bfab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:33.860904 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-814b4d32-38cd-47f2-a39f-51f1d749bfab service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 200  len: 848 time: 0.0795209
May 20 16:21:33.898737 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:33.925028 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:33.932465 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Usage tracker for resource:security_group_rule and tenant:896567cebc8147cabbd4bd76f07a7783 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:33.937819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:33.946251 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:33.950774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-2726ce38-203e-4773-9498-2aad4c0c325e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:33.950774 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-2726ce38-203e-4773-9498-2aad4c0c325e service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=39834042-f759-400b-9bc0-eb7c7abdd5c0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0802848
May 20 16:21:33.965757 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59a46e88-06a4-4f91-90f0-06c36c027830 req-eeb5d1d5-57d2-49d3-8568-f9c377b7543b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:33.967290 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-59a46e88-06a4-4f91-90f0-06c36c027830 req-eeb5d1d5-57d2-49d3-8568-f9c377b7543b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 944 time: 0.1333122
May 20 16:21:34.041138 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-59a46e88-06a4-4f91-90f0-06c36c027830 req-a7f51d1c-72f0-46b1-93a7-b8bd85a83cff tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0640829
May 20 16:21:34.108179 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:34.164929 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-2365ba59-98f1-4e82-b604-c6fc80236232 service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2094491
May 20 16:21:34.299351 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f21d1634-195e-4140-aad1-a6a7a0831aee req-56650ee4-5681-4594-b29c-f791fe5cafb6 service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1279066
May 20 16:21:34.334167 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:34.348123 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2f39837a-831a-4a6a-ae7c-7717766472d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:34.383415 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=896567cebc8147cabbd4bd76f07a7783&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6406631
May 20 16:21:34.385122 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f5ef16f-2e40-43cc-b8be-ac9538eb1cc2,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:34.386409 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35164) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:34.388836 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:34.430356 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['c643d109-2850-418c-806a-4eefcbdcc081'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:21:34.454274 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:34.483831 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:34.609194 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71057e97-cc34-40c7-9d14-f152babe8edb req-c9e504ab-bf40-4c20-a3a6-48fd0f4414b4 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:34.610854 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-71057e97-cc34-40c7-9d14-f152babe8edb req-c9e504ab-bf40-4c20-a3a6-48fd0f4414b4 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.2230425
May 20 16:21:34.682226 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-71057e97-cc34-40c7-9d14-f152babe8edb req-322755f0-af50-446a-b447-4e70a91e380a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0634615
May 20 16:21:34.749939 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:34.753750 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ea7a9165-332a-4461-aab6-b5d06600a438 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:34.765517 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f5ef16f-2e40-43cc-b8be-ac9538eb1cc2,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:34.769145 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:34.773303 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:34.775805 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/9f5ef16f-2e40-43cc-b8be-ac9538eb1cc2 HTTP/1.1" status: 204  len: 168 time: 0.3875468
May 20 16:21:34.865156 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6e9e8d-2db1-473e-b8c4-b188b7f73e9f req-80d9c15c-d5f9-49fd-9331-7c0131036050 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:34.867007 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-af6e9e8d-2db1-473e-b8c4-b188b7f73e9f req-80d9c15c-d5f9-49fd-9331-7c0131036050 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.0830524
May 20 16:21:34.911622 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-af6e9e8d-2db1-473e-b8c4-b188b7f73e9f req-9d5eb871-f5e7-4484-bd78-5a2a5550a202 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385234
May 20 16:21:35.236234 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f093a9c7-d78d-4342-81ac-10f0a4d68a82 req-558ba07f-fdbb-49c2-8773-87503ce560cd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:35.238009 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f093a9c7-d78d-4342-81ac-10f0a4d68a82 req-558ba07f-fdbb-49c2-8773-87503ce560cd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 944 time: 0.0871613
May 20 16:21:35.306508 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f093a9c7-d78d-4342-81ac-10f0a4d68a82 req-584d6274-f0c7-4d21-90ab-c144fae325f4 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0596151
May 20 16:21:35.577575 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35184) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:35.697431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:35.713616 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:35.718692 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Usage tracker for resource:security_group_rule and tenant:7041f72914be4beaba4e55641b04c8a3 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:35.721747 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:35.728130 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:35.771019 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35194) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:35.824641 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:35.838862 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Deleting subnet 119e0a0a-4f75-4580-afee-ce96f3e12878 {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:21:35.842352 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:35.896991 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:35.900506 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35200) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:35.919554 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:35.934730 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:35.943705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Usage tracker for resource:security_group_rule and tenant:a9b0612cf0a4403780f808927d43ff5b is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:35.949184 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:35.956444 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:35.959743 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.000651 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.010722 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:36.069181 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=7041f72914be4beaba4e55641b04c8a3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4903538
May 20 16:21:36.072250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2bbf02a8-6e76-4213-87b0-dedc5f9c2c0a,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:36.075820 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35208) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:36.101723 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:36.164136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.212521 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.225269 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.241029 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device c643d109-2850-418c-806a-4eefcbdcc081 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:36.299559 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.313843 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:36.362642 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=a9b0612cf0a4403780f808927d43ff5b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4605117
May 20 16:21:36.364160 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5442ebd8-2ff6-46ff-ba28-7455401cf5e0,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:36.367098 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35214) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:36.369628 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:36.370679 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc77fdb-51d0-4654-a2e3-7705b7dd11ae req-d0981a3b-bc4c-4311-9496-621c706ab727 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:36.372184 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5cc77fdb-51d0-4654-a2e3-7705b7dd11ae req-d0981a3b-bc4c-4311-9496-621c706ab727 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.3379390
May 20 16:21:36.388060 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57631a08-55d0-4c4f-a84c-ed2be0bbe0fa req-2d0b8fa7-6b76-4853-8bf1-2d62fd713c2f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:36.388060 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-57631a08-55d0-4c4f-a84c-ed2be0bbe0fa req-2d0b8fa7-6b76-4853-8bf1-2d62fd713c2f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.5650208
May 20 16:21:36.423796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.428705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-78115a62-4221-4560-9665-c1fcd5c2a089 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:36.450678 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2bbf02a8-6e76-4213-87b0-dedc5f9c2c0a,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:36.452338 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port c643d109-2850-418c-806a-4eefcbdcc081 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:36.459294 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:36.464224 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.465011 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port c643d109-2850-418c-806a-4eefcbdcc081 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:36.467124 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.476681 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.480557 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/2bbf02a8-6e76-4213-87b0-dedc5f9c2c0a HTTP/1.1" status: 204  len: 168 time: 0.4037912
May 20 16:21:36.503582 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.529504 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5cc77fdb-51d0-4654-a2e3-7705b7dd11ae req-688fbb9f-6a7f-455f-882c-c3d73c26fb59 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1435962
May 20 16:21:36.572357 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-57631a08-55d0-4c4f-a84c-ed2be0bbe0fa req-c9a4a252-8124-4948-96dd-f2b952e61b41 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1681538
May 20 16:21:36.639690 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.669910 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:36.682624 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port c643d109-2850-418c-806a-4eefcbdcc081, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=c643d109-2850-418c-806a-4eefcbdcc081,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:36.716045 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081', 'code': 200}
May 20 16:21:36.720848 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.727551 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-42df6b08-53af-430a-bfa7-4c74ef22fc79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:36.739996 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5442ebd8-2ff6-46ff-ba28-7455401cf5e0,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:36.740245 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98598daa-eb97-4cab-81ea-e76b7fef767b req-f7d6b334-53ab-4065-849b-c7fb128ef1c3 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:36.742370 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98598daa-eb97-4cab-81ea-e76b7fef767b req-f7d6b334-53ab-4065-849b-c7fb128ef1c3 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 944 time: 0.0912583
May 20 16:21:36.744005 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:36.746011 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.749727 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/5442ebd8-2ff6-46ff-ba28-7455401cf5e0 HTTP/1.1" status: 204  len: 168 time: 0.3789501
May 20 16:21:36.777163 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.787669 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:36.835483 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.835712 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:36.837551 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:36.843279 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=119e0a0a-4f75-4580-afee-ce96f3e12878,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:36.849814 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:36.851632 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98598daa-eb97-4cab-81ea-e76b7fef767b req-9980b75e-6a09-4f14-abb7-61fb54a30d8f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0952981
May 20 16:21:36.859915 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-2393dfc0-ccf6-47ad-a633-e0ab408302f5 admin admin] 10.222.0.64 "DELETE /v2.0/subnets/119e0a0a-4f75-4580-afee-ce96f3e12878 HTTP/1.1" status: 204  len: 168 time: 1.0865757
May 20 16:21:36.861653 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35224) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:36.905909 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=c643d109-2850-418c-806a-4eefcbdcc081,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:36.909139 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:36.967242 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:37.096621 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:37.111481 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe712354eb0>,) {'filters': {'network_id': ['ff8e44fb-6ead-46de-8521-764b50418880']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:37.159086 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe712354eb0>, '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:37.159615 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe712354eb0>, '586db0b1-2bc2-4dce-8d66-88ecd6bc05d3') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:37.183565 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:37.210862 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:37.221353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Releasing vlan 643 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:21:37.221757 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:21:37.236406 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:21:37.329631 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e6d21a-0dc3-4aba-9bf1-62cefa5739ef req-ecae5352-07a0-4794-af38-e5fb31ac8cd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:37.331210 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d8e6d21a-0dc3-4aba-9bf1-62cefa5739ef req-ecae5352-07a0-4794-af38-e5fb31ac8cd7 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1098 time: 0.2096939
May 20 16:21:37.403336 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d8e6d21a-0dc3-4aba-9bf1-62cefa5739ef req-2fb0d2bb-0208-46e9-ad43-6654696576ca service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412116
May 20 16:21:37.404028 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:37.410739 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:37.411788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:37.435971 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Pushing event deleted for resources: {'Network': ['ID=ff8e44fb-6ead-46de-8521-764b50418880,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:37.439294 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:37.550308 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-bda02418-dbf3-46e2-b413-cbfb4e3ce129 admin admin] 10.222.0.64 "DELETE /v2.0/networks/ff8e44fb-6ead-46de-8521-764b50418880 HTTP/1.1" status: 204  len: 168 time: 0.6871624
May 20 16:21:37.785569 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ed6de8-a351-4fee-a99a-d7b7ce302d3c req-1a4e5571-babc-4485-ba68-e00b19021146 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:37.787057 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-31ed6de8-a351-4fee-a99a-d7b7ce302d3c req-1a4e5571-babc-4485-ba68-e00b19021146 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1442134
May 20 16:21:37.849248 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79d18df-7957-47ac-9c0f-9e198e0f6da3 req-52a8a7a7-5d10-4bc7-8a70-4016e04801a3 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:37.851157 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c79d18df-7957-47ac-9c0f-9e198e0f6da3 req-52a8a7a7-5d10-4bc7-8a70-4016e04801a3 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.1385617
May 20 16:21:37.861743 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-31ed6de8-a351-4fee-a99a-d7b7ce302d3c req-3e4d6c82-0524-477b-970d-ea263fc10a07 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0666032
May 20 16:21:37.913035 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c79d18df-7957-47ac-9c0f-9e198e0f6da3 req-eba592ce-d668-42f3-8929-adf2dc1bec3e tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0488195
May 20 16:21:37.982854 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35284) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:38.045061 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-148131c9-f8f2-4e64-8523-612a74e330c9 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=bfea173096cf4b509735ffd535193ea5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0605185
May 20 16:21:38.047413 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35292) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:38.089827 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c16e01-bc40-4fd2-8112-f6dca10e77f1 req-e7170ba4-4844-442c-9c0b-16e21f726450 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:38.097521 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-80c16e01-bc40-4fd2-8112-f6dca10e77f1 req-e7170ba4-4844-442c-9c0b-16e21f726450 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1179993
May 20 16:21:38.132995 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:38.146092 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-80c16e01-bc40-4fd2-8112-f6dca10e77f1 req-5eadfdc7-a3c4-49fd-a51e-4747c6c8aa2e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0476391
May 20 16:21:38.151275 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:38.264717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:38.270346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f05d39f1-86d2-4ee9-a189-f314bdf2e47c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:38.284940 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04045ca2-7857-4449-8fcc-f44af2699567,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:38.293957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:38.296290 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:38.302263 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/04045ca2-7857-4449-8fcc-f44af2699567 HTTP/1.1" status: 204  len: 168 time: 0.2488461
May 20 16:21:39.309870 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d376d0-7bff-4872-85fe-be486fca66c2 req-7af50000-4a53-4dbe-8256-5a1337fff008 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:39.320216 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4d376d0-7bff-4872-85fe-be486fca66c2 req-7af50000-4a53-4dbe-8256-5a1337fff008 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.1701899
May 20 16:21:39.426983 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4d376d0-7bff-4872-85fe-be486fca66c2 req-e70d6f0d-ee2c-4424-9066-c7d8ab8af528 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1054935
May 20 16:21:39.619122 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449d5dfc-eda8-49a2-a5ce-9636c4549952 req-f8f8f01a-76b7-4879-846e-683a49e06acf tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:39.626651 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-449d5dfc-eda8-49a2-a5ce-9636c4549952 req-f8f8f01a-76b7-4879-846e-683a49e06acf tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1943326
May 20 16:21:39.742661 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-449d5dfc-eda8-49a2-a5ce-9636c4549952 req-e9cbdbbc-a012-406e-aa8c-29d14e95e4b0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1150575
May 20 16:21:39.809523 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456ee09c-fb35-47ad-aebe-1be06ec93c7a req-3949259a-b55d-4ee0-b4b0-0bf8671ca358 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:39.817470 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-456ee09c-fb35-47ad-aebe-1be06ec93c7a req-3949259a-b55d-4ee0-b4b0-0bf8671ca358 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1721752
May 20 16:21:39.872134 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-456ee09c-fb35-47ad-aebe-1be06ec93c7a req-50d0118b-cc79-4987-bd7a-50b5fc71f827 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0512106
May 20 16:21:40.223855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e79159-3651-448e-8749-12f9a556edf9 req-b3521281-b5ea-4af0-bedc-30ffba3d763c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:40.225456 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c3e79159-3651-448e-8749-12f9a556edf9 req-b3521281-b5ea-4af0-bedc-30ffba3d763c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1202497
May 20 16:21:40.238885 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35350) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:40.245339 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'floatingip': {'port_id': 'c643d109-2850-418c-806a-4eefcbdcc081'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:40.339052 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:41.194591 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d2aa16-e483-4bd7-859d-8bc011515baa req-61b27c23-04b1-4f95-8e75-9012536f4c29 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:41.196174 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9d2aa16-e483-4bd7-859d-8bc011515baa req-61b27c23-04b1-4f95-8e75-9012536f4c29 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.4091873
May 20 16:21:41.263618 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6943ef0f-912c-420a-8843-cc6d84e89a2b req-3def1aa2-9ead-4f03-a796-6f00e47048a7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:41.265206 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6943ef0f-912c-420a-8843-cc6d84e89a2b req-3def1aa2-9ead-4f03-a796-6f00e47048a7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.2559674
May 20 16:21:41.349126 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e9d2aa16-e483-4bd7-859d-8bc011515baa req-eef628a7-e8b5-4bcd-bf7f-a0916ea5438c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1065395
May 20 16:21:41.365677 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6943ef0f-912c-420a-8843-cc6d84e89a2b req-4e7426a3-6f17-4d13-955e-e09ab02e56b0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0842905
May 20 16:21:41.513815 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:41.595692 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:41.802374 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Floating IP 0c7ce331-86f1-4fc2-8c6b-06391e928dca associated. External IP: 172.27.0.211, port: c643d109-2850-418c-806a-4eefcbdcc081.
May 20 16:21:42.199886 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Router 27c15c4b-53de-4418-8ed7-78ad6d465033 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:21:42.403857 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:21:42.410819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:42.416862 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] Sync routers for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:21:42.427277 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:21:42.428488 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712e9cdc0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:21:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:42.537282 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-2a1a36b4-4663-4876-a853-a96004296540 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "PUT /v2.0/floatingips/0c7ce331-86f1-4fc2-8c6b-06391e928dca HTTP/1.1" status: 200  len: 991 time: 2.2943380
May 20 16:21:42.537282 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:42.571974 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a44338-c977-47a8-852e-3a5b15dcceef req-a6762f18-0725-4c74-8dc3-177c420ee11d tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:42.573594 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2a44338-c977-47a8-852e-3a5b15dcceef req-a6762f18-0725-4c74-8dc3-177c420ee11d tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.1234312
May 20 16:21:42.694074 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2a44338-c977-47a8-852e-3a5b15dcceef req-23f0f48e-e2cf-4142-a0f7-1943fddf2648 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0843625
May 20 16:21:42.721315 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-527fd50a-bac3-4fbc-bf90-246f0f834707 req-d9a16af1-84f8-4969-b686-48e2b6ad61bb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:42.729957 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-527fd50a-bac3-4fbc-bf90-246f0f834707 req-d9a16af1-84f8-4969-b686-48e2b6ad61bb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1665401
May 20 16:21:42.764598 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:21:42.896121 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081', 'status': 'completed', 'code': 200}
May 20 16:21:42.929437 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-527fd50a-bac3-4fbc-bf90-246f0f834707 req-9048dd27-2054-415a-ae6e-396cd50a086d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1983712
May 20 16:21:43.015744 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-65c2269f-2f56-4555-b1e3-23f5adaa2124 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:43.017256 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-65c2269f-2f56-4555-b1e3-23f5adaa2124 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1098 time: 0.1051073
May 20 16:21:43.085693 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-b3c1cb01-88dd-46c9-b317-ad9c8e1820f8 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/networks?tenant_id=04ea77fcf30a4817bec5800ecff20065&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0554171
May 20 16:21:43.299647 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-d30daca5-d81f-4616-b9ad-4a643c37bb6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:43.303366 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712e9cdc0>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '0c7ce331-86f1-4fc2-8c6b-06391e928dca', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'floating_ip_address': '172.27.0.211', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'port_id': 'c643d109-2850-418c-806a-4eefcbdcc081', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 437, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'mac_address': 'fa:16:3e:93:c3:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd419699d-6355-4177-82f9-39936e18d34c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:21:13Z', 'updated_at': '2021-05-20T16:21:41Z', 'revision_number': 1, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:43.306164 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-d30daca5-d81f-4616-b9ad-4a643c37bb6c service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.2765307
May 20 16:21:43.310202 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] Checking router: 27c15c4b-53de-4418-8ed7-78ad6d465033 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:21:43.343531 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:21:43.344185 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712e9cdc0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:21:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:43.364027 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-40da210f-dc40-43a4-894b-7037322f9f75 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:43.373187 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-40da210f-dc40-43a4-894b-7037322f9f75 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.2858863
May 20 16:21:43.399278 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-926996c2-def9-4489-9a40-87ecc6686f72 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/quotas/04ea77fcf30a4817bec5800ecff20065 HTTP/1.1" status: 200  len: 375 time: 0.0246124
May 20 16:21:43.498111 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-fcbd98e2-684e-4a84-aa3d-de1bf2aac7de tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=04ea77fcf30a4817bec5800ecff20065&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0976861
May 20 16:21:43.586796 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-94774eaf-771d-47d7-9bd7-a85863e291e7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 999 time: 0.2723477
May 20 16:21:43.697669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-3e7fed93-4dde-4f42-9c78-1460ba5a8a37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:43.699399 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-3e7fed93-4dde-4f42-9c78-1460ba5a8a37 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.1055796
May 20 16:21:43.731331 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:21:43.895935 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-df924771-2cbd-4de3-b830-e416a18f84d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:43.898130 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-df924771-2cbd-4de3-b830-e416a18f84d5 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1818206
May 20 16:21:44.289558 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-11ee822d-9aaf-435f-8d1d-56d959dba31e service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3835475
May 20 16:21:44.302260 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device df15e363-aade-4bfb-9359-102c4aa7cae5 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:21:44.329960 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-450a2cef-771a-45ce-bd5a-e0b9b1f29f49 req-c24656f7-aa8c-48f6-a878-9382ae2c90ea tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.1362841
May 20 16:21:44.339446 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712e9cdc0>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '0c7ce331-86f1-4fc2-8c6b-06391e928dca', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'floating_ip_address': '172.27.0.211', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'port_id': 'c643d109-2850-418c-806a-4eefcbdcc081', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 437, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'mac_address': 'fa:16:3e:93:c3:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd419699d-6355-4177-82f9-39936e18d34c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:21:13Z', 'updated_at': '2021-05-20T16:21:41Z', 'revision_number': 1, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:21:44.357700 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-533c2859-7c6e-4f72-bd5c-05dd0fc64695 None None] The sync data for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi is: [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '0c7ce331-86f1-4fc2-8c6b-06391e928dca', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'floating_ip_address': '172.27.0.211', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'port_id': 'c643d109-2850-418c-806a-4eefcbdcc081', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 437, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'mac_address': 'fa:16:3e:93:c3:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd419699d-6355-4177-82f9-39936e18d34c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:21:13Z', 'updated_at': '2021-05-20T16:21:41Z', 'revision_number': 1, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:21:44.380255 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5cf9932-9e22-4501-bec0-2ab03d8a091e req-7e80cdda-7444-418a-a2d9-80d5e6c8a8d0 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:44.389905 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b5cf9932-9e22-4501-bec0-2ab03d8a091e req-7e80cdda-7444-418a-a2d9-80d5e6c8a8d0 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.3918707
May 20 16:21:44.515339 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b5cf9932-9e22-4501-bec0-2ab03d8a091e req-491bfdf1-68f5-4f66-ac36-bb2433984c03 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1219139
May 20 16:21:44.675850 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-5ae8d883-8beb-49e3-9a19-b3e217c01ec8 req-b29f68fc-2ed8-496b-b358-afee773b1937 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3759899
May 20 16:21:44.704507 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:44.729436 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'port_id': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'mac_address': 'fa:16:3e:b7:cd:f0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 629, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:21:44.753876 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39acb1e5-e12d-41f6-bab6-d7a3a30f882f req-d45897a0-518f-45a1-87ee-c3ea62a9f12f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:44.755598 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-39acb1e5-e12d-41f6-bab6-d7a3a30f882f req-d45897a0-518f-45a1-87ee-c3ea62a9f12f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1592531
May 20 16:21:44.797410 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cf3b19c-d690-4cef-b8e7-8c1bc13d11c0 None None] New status for floating IP 0c7ce331-86f1-4fc2-8c6b-06391e928dca: ACTIVE {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:21:44.810917 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:44.824332 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-39acb1e5-e12d-41f6-bab6-d7a3a30f882f req-ea7dd1d3-bd8d-4b55-acd6-b6695c32d213 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0626292
May 20 16:21:44.834538 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id df15e363-aade-4bfb-9359-102c4aa7cae5 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:44.855146 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:44.978037 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:44.980849 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:45.076641 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:45.080433 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:45.465209 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['df15e363-aade-4bfb-9359-102c4aa7cae5'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:21:45.525416 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-517c5420-fc36-47b6-8aac-214c0a6c1968 req-d8d523e3-f75a-4273-be8c-5feec71be3c2 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.1138344
May 20 16:21:45.804714 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb17ae9-57a9-4e3d-8d2a-dd5914d790e3 req-f99e07cd-727f-4a41-b7db-1e825541c8f7 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:45.806281 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edb17ae9-57a9-4e3d-8d2a-dd5914d790e3 req-f99e07cd-727f-4a41-b7db-1e825541c8f7 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.1070020
May 20 16:21:45.870686 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edb17ae9-57a9-4e3d-8d2a-dd5914d790e3 req-39abf47d-481e-401c-8d06-7fb2b8acd713 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0556939
May 20 16:21:45.985648 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3382df03-9893-4c52-9e10-279cd10bc63f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:46.100219 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1a94b5-d503-446f-b8ef-06d01f34a5be req-d04b750c-6729-4dc3-b6d5-c6c74d61a2ba tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:46.104571 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aa1a94b5-d503-446f-b8ef-06d01f34a5be req-d04b750c-6729-4dc3-b6d5-c6c74d61a2ba tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1233735
May 20 16:21:46.209961 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aa1a94b5-d503-446f-b8ef-06d01f34a5be req-b32b8c19-f727-4469-863c-78f52e30c9ed tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0945184
May 20 16:21:46.452411 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35460) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:46.644719 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:46.675089 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:46.681831 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Usage tracker for resource:security_group_rule and tenant:eefa846ec8274150b008eea7cc1f132c is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:46.686445 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:46.699977 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:46.779040 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f03250e-1a00-489a-9487-0fff23ca695f req-0c2e98de-440a-43c5-941e-71da67d0d384 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.0542841
May 20 16:21:46.834733 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:46.914783 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:46.924784 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6e9a0779-416e-4dee-b2be-efdc6b1361f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:46.976455 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=eefa846ec8274150b008eea7cc1f132c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5226829
May 20 16:21:46.979110 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25e8549b-b16f-43d1-a8e8-71b4a19d345e,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:46.979404 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35470) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:46.985252 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:47.106429 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:47.147685 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:47.182456 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e37f6f92-d52f-4bae-a29e-600ba3e6449e req-5eb5d6d0-c7a3-4d5e-909e-d8c604b56722 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:47.184024 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e37f6f92-d52f-4bae-a29e-600ba3e6449e req-5eb5d6d0-c7a3-4d5e-909e-d8c604b56722 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.1794121
May 20 16:21:47.260626 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e37f6f92-d52f-4bae-a29e-600ba3e6449e req-1a107c63-90fc-4c4f-9d2d-12362c09f563 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0700715
May 20 16:21:47.435369 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:47.440180 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-9e332de7-fa22-4412-a1fb-5b0e69f0d207 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:47.452498 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25e8549b-b16f-43d1-a8e8-71b4a19d345e,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:47.454792 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:47.458366 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:47.460256 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/25e8549b-b16f-43d1-a8e8-71b4a19d345e HTTP/1.1" status: 204  len: 168 time: 0.4796886
May 20 16:21:47.568978 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca15d4a-4994-443e-83ac-0162c318dfb1 req-7074db4e-d58c-4c42-ae1e-78f8242cf761 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:47.570474 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4ca15d4a-4994-443e-83ac-0162c318dfb1 req-7074db4e-d58c-4c42-ae1e-78f8242cf761 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.2124460
May 20 16:21:47.622623 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4ca15d4a-4994-443e-83ac-0162c318dfb1 req-79c11119-4471-4678-b51f-08ca6073c196 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419316
May 20 16:21:47.949428 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-48e204b1-2a13-4ea4-b8d2-e33ad998ea55 req-38e9df65-cf3a-42b6-bc39-88feba2edad2 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.0578191
May 20 16:21:48.298522 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35492) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:48.331588 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:48.353226 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:48.366980 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Usage tracker for resource:security_group_rule and tenant:ab0ca658fde74addbdcca58d41e36d6e is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:48.383092 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:48.391771 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:48.429776 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:48.510830 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:48.543029 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b605fbf9-4d96-4dbc-a64d-9aaeec5666ff req-ca2d015d-f3bf-437d-992e-a7887a2093e8 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:48.544737 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b605fbf9-4d96-4dbc-a64d-9aaeec5666ff req-ca2d015d-f3bf-437d-992e-a7887a2093e8 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.1152713
May 20 16:21:48.594403 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:48.603511 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f7ebe316-1580-4cde-9424-2e7f958ad44c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:48.609365 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b605fbf9-4d96-4dbc-a64d-9aaeec5666ff req-09d91de4-323e-4aa1-9904-1782ed77f746 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0518315
May 20 16:21:48.638700 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80961c5f-3899-470c-9b96-4e367936f1bc,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:48.639263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:48.658164 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-98eba839-3f99-415b-a818-127d060b3b6a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:48.664763 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ab0ca658fde74addbdcca58d41e36d6e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3645675
May 20 16:21:48.667638 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35500) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:48.755774 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:48.842936 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:48.924715 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b99c7649-d4cb-48b6-8012-87203d548f76 req-a8cdfb51-4014-4ee6-bb74-4afdb41ed81d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:48.926107 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b99c7649-d4cb-48b6-8012-87203d548f76 req-a8cdfb51-4014-4ee6-bb74-4afdb41ed81d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1520171
May 20 16:21:48.981566 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b99c7649-d4cb-48b6-8012-87203d548f76 req-22bc89bc-38d0-48bb-8b7d-3f12361ca972 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0465548
May 20 16:21:49.041108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:49.046859 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-68f9f6b9-9d1f-4d68-9271-5971504796ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:49.060476 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80961c5f-3899-470c-9b96-4e367936f1bc,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:49.064731 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:49.068743 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:49.071135 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/80961c5f-3899-470c-9b96-4e367936f1bc HTTP/1.1" status: 204  len: 168 time: 0.4025733
May 20 16:21:49.181605 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cd286c9e-7b7b-4f0b-a15d-7b4cc21611d0 req-135ad1da-1721-47dd-a946-d65507e1deff tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.0504560
May 20 16:21:49.646724 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:49.883108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e218c8-c302-4603-96fa-df860123c85f req-19d1edd9-94e3-41e6-a121-ad409524cf90 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:49.885524 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-02e218c8-c302-4603-96fa-df860123c85f req-19d1edd9-94e3-41e6-a121-ad409524cf90 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.1073720
May 20 16:21:49.960119 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-02e218c8-c302-4603-96fa-df860123c85f req-3c51831e-fa60-4578-be31-9823835c35cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0649695
May 20 16:21:50.216515 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025c62b5-7bf7-46d8-bf4f-209cce44cf68 req-0db9885b-b8f4-42fe-b90e-1f5def85a5a7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:50.219118 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-025c62b5-7bf7-46d8-bf4f-209cce44cf68 req-0db9885b-b8f4-42fe-b90e-1f5def85a5a7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1089461
May 20 16:21:50.391307 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-025c62b5-7bf7-46d8-bf4f-209cce44cf68 req-fb67e53e-1e62-4c54-a0ff-c5a7f90d0d1b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1631074
May 20 16:21:50.571820 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-df3f5b0a-6674-4772-bc97-bb3df68f0711 req-1c738ae0-b7a8-425d-8962-35332cee1640 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.0498426
May 20 16:21:50.969339 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:21:51.168847 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76ae1556-2088-42e7-9e08-061db1e36f65 req-6aa580c0-de82-4ba9-aebe-2cf1f300ebea tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:51.170344 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76ae1556-2088-42e7-9e08-061db1e36f65 req-6aa580c0-de82-4ba9-aebe-2cf1f300ebea tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.1094365
May 20 16:21:51.217083 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76ae1556-2088-42e7-9e08-061db1e36f65 req-57b138ba-9af9-4646-aeae-b74ddfe16e08 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404704
May 20 16:21:51.268826 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:51.647851 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525b2335-0acd-48d7-b6dc-0882d54beda5 req-7b0877d1-b2e3-481c-b75e-debbd05fc2f4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:51.650655 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-525b2335-0acd-48d7-b6dc-0882d54beda5 req-7b0877d1-b2e3-481c-b75e-debbd05fc2f4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1095970
May 20 16:21:51.715643 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-525b2335-0acd-48d7-b6dc-0882d54beda5 req-f3b98967-cdb6-4bba-aa82-187e23263f94 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0586579
May 20 16:21:51.856504 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e2d20d29-7064-47e4-947a-4ec2aac9db36 req-9065f29f-856e-4dc9-b1c7-b393a2bcee5e tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.0795889
May 20 16:21:52.415525 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f594bbb-c0b1-4d1e-bd02-e36a638effee req-bb153576-51b1-4bef-984a-92bd65402b1c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:52.417048 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7f594bbb-c0b1-4d1e-bd02-e36a638effee req-bb153576-51b1-4bef-984a-92bd65402b1c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.0912945
May 20 16:21:52.468545 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7f594bbb-c0b1-4d1e-bd02-e36a638effee req-6522e6cb-8b6d-42a4-9369-61a1a2c601cd tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0451381
May 20 16:21:52.496942 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-9bc0ab4c-6434-48b8-a57f-d3f943bdc10f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.16 "GET /v2.0/networks?tenant_id=04ea77fcf30a4817bec5800ecff20065&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0442379
May 20 16:21:52.677952 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-0dd75760-179a-4178-9147-fb4d83775d2c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:52.679530 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-0dd75760-179a-4178-9147-fb4d83775d2c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1780956
May 20 16:21:52.693172 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Request body: {'port': {'device_id': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7', 'admin_state_up': True, 'tenant_id': '04ea77fcf30a4817bec5800ecff20065'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:52.830872 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:52.835502 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Usage tracker for resource:port and tenant:04ea77fcf30a4817bec5800ecff20065 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:52.839923 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:52.846216 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:52.934665 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35606) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:52.971151 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da9709f-6108-4a67-9106-8b8f569544fe req-a720544a-7cf3-4d87-bf2e-82dc7c314a6a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:52.972776 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3da9709f-6108-4a67-9106-8b8f569544fe req-a720544a-7cf3-4d87-bf2e-82dc7c314a6a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.0927846
May 20 16:21:52.977421 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Made reservation on behalf of 04ea77fcf30a4817bec5800ecff20065 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:21:52.981324 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.002501 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.025671 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:53.031818 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Usage tracker for resource:security_group_rule and tenant:04ea77fcf30a4817bec5800ecff20065 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:53.035993 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:53.048972 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bad5e08f-ee1a-4329-8d6d-e2b2ae4efeda req-7f52466a-6342-4185-80a4-930dc715e078 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.0668192
May 20 16:21:53.052169 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:53.087371 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3da9709f-6108-4a67-9106-8b8f569544fe req-7cf0ffca-1f61-47af-a398-b51599f29f22 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0716245
May 20 16:21:53.125852 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.154301 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:53.173884 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Usage tracker for resource:security_group_rule and tenant:72fd3a6d47554f318dc24c7518bd78bd is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:53.180450 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.181702 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:53.187909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:53.283999 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.288634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0bda5074-8c5d-4852-9738-72ec676778f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:53.386573 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:53.393776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:53.500717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Allocated IP 192.168.233.40 (81e1d97d-8a33-4044-83b4-907740b1aca7/c1eae10b-39b6-4f33-8f12-5a3e9efa6216/2c8d7819-4077-463a-a3bc-0dcb0497beeb) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:21:53.524566 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.618214 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.667022 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:53.667277 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eccccc-eedd-4ab7-bfa7-41db2760da28 req-17f96687-79ab-4ea1-8a36-19ddb03d8ec0 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:53.668709 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-50eccccc-eedd-4ab7-bfa7-41db2760da28 req-17f96687-79ab-4ea1-8a36-19ddb03d8ec0 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.0904551
May 20 16:21:53.717662 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-50eccccc-eedd-4ab7-bfa7-41db2760da28 req-3b1c1aba-0eb8-4646-b803-7909fef97bd3 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427992
May 20 16:21:53.739833 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=72fd3a6d47554f318dc24c7518bd78bd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8018179
May 20 16:21:53.742599 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35622) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:53.747963 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ba734a6-c3ea-41c8-8e43-df121505a2c9,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:53.753696 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:53.774378 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.790488 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Transition to ACTIVE for port object 2c8d7819-4077-463a-a3bc-0dcb0497beeb will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:53.804420 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.829967 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.915531 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.924111 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2d932712-cb97-4f01-b196-1428039f6006 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:53.943678 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.949377 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-820b4983-1cd4-43d4-854a-c4710608fd62 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:53.962957 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ba734a6-c3ea-41c8-8e43-df121505a2c9,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:53.971139 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.971466 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.971829 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.972183 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.972535 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.972885 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.973233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.973579 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.973926 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.974267 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.974611 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.974946 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:21:53.978605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:53.982278 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/4ba734a6-c3ea-41c8-8e43-df121505a2c9 HTTP/1.1" status: 204  len: 168 time: 0.2361474
May 20 16:21:53.982278 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:54.102219 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device df15e363-aade-4bfb-9359-102c4aa7cae5 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:21:54.117485 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Network 81e1d97d-8a33-4044-83b4-907740b1aca7 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:21:54.128846 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:21:54.129921 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:21:54.160286 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Pushing event updated for resources: {'Port': ['ID=2c8d7819-4077-463a-a3bc-0dcb0497beeb,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:54.163904 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:54.210603 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:54.212178 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.241573 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-616f794d-b739-4cb4-b623-aed9e049a727 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:54.241573 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-616f794d-b739-4cb4-b623-aed9e049a727 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1098 time: 0.3594661
May 20 16:21:54.326164 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port df15e363-aade-4bfb-9359-102c4aa7cae5 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:54.331337 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port df15e363-aade-4bfb-9359-102c4aa7cae5 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:54.331894 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.390163 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0aba17-a935-4a3c-a4dc-7fdc04532547 req-b36ceb99-7e48-42df-b9fe-129648a2a892 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:54.397841 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d0aba17-a935-4a3c-a4dc-7fdc04532547 req-b36ceb99-7e48-42df-b9fe-129648a2a892 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 935 time: 0.2018366
May 20 16:21:54.425287 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 937 time: 1.7365253
May 20 16:21:54.425511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4861ddf9-fa23-452e-a187-2b2cccb4eb2d req-92f024c2-0bc6-48ef-8d66-6e0e925701b8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:54.426565 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-3f1e494c-4060-4f51-b9f0-cf9f36bb2a2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:54.428719 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-3f1e494c-4060-4f51-b9f0-cf9f36bb2a2e service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1773579
May 20 16:21:54.431985 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4861ddf9-fa23-452e-a187-2b2cccb4eb2d req-92f024c2-0bc6-48ef-8d66-6e0e925701b8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 945 time: 0.1591601
May 20 16:21:54.443422 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Request body: {'port': {'device_id': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:21:54.501661 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.507904 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d0aba17-a935-4a3c-a4dc-7fdc04532547 req-9ce011cb-427b-4137-b350-6cd295ac26f1 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1091237
May 20 16:21:54.523025 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4861ddf9-fa23-452e-a187-2b2cccb4eb2d req-48e59d5b-628c-4290-9941-20ec4eb6e4ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0876045
May 20 16:21:54.550711 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:54.577889 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:54.583194 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-881fb894-0700-46ad-b7a8-14a6188584a7 None None] Provisioning for port 2c8d7819-4077-463a-a3bc-0dcb0497beeb completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:21:54.593519 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-881fb894-0700-46ad-b7a8-14a6188584a7 None None] Provisioning complete for port 2c8d7819-4077-463a-a3bc-0dcb0497beeb triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:21:54.593519 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-881fb894-0700-46ad-b7a8-14a6188584a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.629470 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'code': 200}
May 20 16:21:54.652600 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-9ce5a1c3-0072-477c-aa4e-9debc4a64666 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 1000 time: 0.1690121
May 20 16:21:54.654936 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-881fb894-0700-46ad-b7a8-14a6188584a7 None None] Port 2c8d7819-4077-463a-a3bc-0dcb0497beeb cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:21:54.664990 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.680520 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.681380 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:21:54.708791 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:54.801830 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:54.807259 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:54.860205 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.887035 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35644) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:54.895565 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:21:54.915993 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.933890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:21:54.939517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Usage tracker for resource:security_group_rule and tenant:31830f0ac74e40d8a2b91922b0eb28bd is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:21:54.943135 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:21:54.950918 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:21:54.971949 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:54.973916 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:54.985102 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07995897-22e2-4808-bbbc-4a4dafbc7511 req-661533e1-694e-45ed-aed2-09184dcec548 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:54.986533 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07995897-22e2-4808-bbbc-4a4dafbc7511 req-661533e1-694e-45ed-aed2-09184dcec548 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1534646
May 20 16:21:55.047520 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07995897-22e2-4808-bbbc-4a4dafbc7511 req-2844d8af-abed-497c-9be4-704c55e32553 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0533764
May 20 16:21:55.050127 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=8']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:55.054506 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:55.058591 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2c8d7819-4077-463a-a3bc-0dcb0497beeb {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:21:55.068456 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.088465 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Transition to ACTIVE for port object 2c8d7819-4077-463a-a3bc-0dcb0497beeb will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:21:55.092603 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.183221 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.187152 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-06b93554-7cb6-432d-8ac2-8a5e8e2bb19f tempest-ServerRescueNegativeTestJSON-603400711 tempest-ServerRescueNegativeTestJSON-603400711-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:55.206061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.213014 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c9994296-6888-4bb6-9388-efb7847da4f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:55.262510 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34f4d861-f21c-423c-9149-32c35cbc5bc3,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:55.266371 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:55.269163 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=31830f0ac74e40d8a2b91922b0eb28bd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3800442
May 20 16:21:55.273512 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35650) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:21:55.356437 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.388389 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.391980 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Pushing event updated for resources: {'Port': ['ID=2c8d7819-4077-463a-a3bc-0dcb0497beeb,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:55.395139 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:55.443314 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Attempting to bind port 2c8d7819-4077-463a-a3bc-0dcb0497beeb on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:21:55.443705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Attempting to bind port 2c8d7819-4077-463a-a3bc-0dcb0497beeb by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:21:55.444077 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Attempting to bind port 2c8d7819-4077-463a-a3bc-0dcb0497beeb on network 81e1d97d-8a33-4044-83b4-907740b1aca7 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:55.449392 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Port 2c8d7819-4077-463a-a3bc-0dcb0497beeb on network 81e1d97d-8a33-4044-83b4-907740b1aca7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:21:55.449733 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Attempting to bind port 2c8d7819-4077-463a-a3bc-0dcb0497beeb on network 81e1d97d-8a33-4044-83b4-907740b1aca7 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:21:55.465826 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 21, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:21:55.465826 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Checking segment: {'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:21:55.465826 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Bound using segment: {'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:21:55.465826 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Bound port: 2c8d7819-4077-463a-a3bc-0dcb0497beeb, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b6d80164-e565-4ad3-a39d-687326b982c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:21:55.465826 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.550476 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.554789 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cceb3783-488b-4993-824e-3682f8e253fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:55.565190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] For port 2c8d7819-4077-463a-a3bc-0dcb0497beeb, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:21:55.568302 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34f4d861-f21c-423c-9149-32c35cbc5bc3,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:55.568455 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] For port 2c8d7819-4077-463a-a3bc-0dcb0497beeb, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=2c8d7819-4077-463a-a3bc-0dcb0497beeb,segment=NetworkSegment(b6d80164-e565-4ad3-a39d-687326b982c6),segment_id=b6d80164-e565-4ad3-a39d-687326b982c6)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:21:55.571443 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:55.572806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.576669 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/34f4d861-f21c-423c-9149-32c35cbc5bc3 HTTP/1.1" status: 204  len: 168 time: 0.2994344
May 20 16:21:55.669263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.674199 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-74199216-50f6-4672-aaab-b135013438ca service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:21:55.705187 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aff9c22-9eae-463d-99c7-bd78755888f1 req-b6861949-0459-43f8-b93e-f541371d97ac tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:55.706766 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4aff9c22-9eae-463d-99c7-bd78755888f1 req-b6861949-0459-43f8-b93e-f541371d97ac tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.0841670
May 20 16:21:55.733332 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:55.733944 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:55.735330 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] 10.222.0.16 "PUT /v2.0/ports/2c8d7819-4077-463a-a3bc-0dcb0497beeb HTTP/1.1" status: 200  len: 1097 time: 1.2973793
May 20 16:21:55.735876 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'tag': '2c8d7819-4077-463a-a3bc-0dcb0497beeb'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:55.768430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Pushing event updated for resources: {'Port': ['ID=2c8d7819-4077-463a-a3bc-0dcb0497beeb,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:21:55.769186 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4aff9c22-9eae-463d-99c7-bd78755888f1 req-5992e2f1-db28-4e9a-ba8c-8312542bcb8f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0546267
May 20 16:21:55.775379 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:21:55.951036 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd40f4f-9350-4854-ab23-2fac9119f599 req-0c3c8296-3cc2-47c1-8667-3021c4ac4796 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:55.952552 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ebd40f4f-9350-4854-ab23-2fac9119f599 req-0c3c8296-3cc2-47c1-8667-3021c4ac4796 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0869744
May 20 16:21:55.998554 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ebd40f4f-9350-4854-ab23-2fac9119f599 req-bc38fd3a-b77a-4e11-8951-ec21cf942c05 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399725
May 20 16:21:56.055115 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'tag': '2c8d7819-4077-463a-a3bc-0dcb0497beeb', 'status': 'completed', 'code': 200}
May 20 16:21:56.253781 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4be711e-dad8-4a85-a218-78ae0adb2d96 req-4bec0b03-b00e-4c94-9f9b-db640885a98f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:56.255362 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e4be711e-dad8-4a85-a218-78ae0adb2d96 req-4bec0b03-b00e-4c94-9f9b-db640885a98f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0858095
May 20 16:21:56.300690 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e4be711e-dad8-4a85-a218-78ae0adb2d96 req-d4c2cb1b-85c8-4863-beb0-4bf781e289a2 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394840
May 20 16:21:56.630342 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:21:56.677622 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'code': 200}
May 20 16:21:56.953043 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b7b83d-9f81-445d-845c-1f5bd792d86d req-ba94198b-db6e-43fe-9281-e6863a6a42df tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:56.954724 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2b7b83d-9f81-445d-845c-1f5bd792d86d req-ba94198b-db6e-43fe-9281-e6863a6a42df tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.0815444
May 20 16:21:57.003826 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2b7b83d-9f81-445d-845c-1f5bd792d86d req-d045616d-9b26-493c-8c3c-b7a1b1288998 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428998
May 20 16:21:57.272921 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e29c1049-2abf-4e07-bd50-a862c0b025a8 req-4784985d-85f3-4556-a93c-aeeb7b732ea2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:57.274514 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e29c1049-2abf-4e07-bd50-a862c0b025a8 req-4784985d-85f3-4556-a93c-aeeb7b732ea2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1616280
May 20 16:21:57.320589 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e29c1049-2abf-4e07-bd50-a862c0b025a8 req-112b5139-c16b-426b-a278-ab08a43d83db tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400665
May 20 16:21:57.507488 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5b274a-1c69-4c4c-b414-35a60ec22e9d req-0e9a256f-175c-4275-aaf6-f5cbc545d0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:57.509208 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0a5b274a-1c69-4c4c-b414-35a60ec22e9d req-0e9a256f-175c-4275-aaf6-f5cbc545d0cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0906649
May 20 16:21:57.543981 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-ae6f586c-9019-4920-8501-1749c82eecd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:57.545458 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-ae6f586c-9019-4920-8501-1749c82eecd1 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0660126
May 20 16:21:57.556911 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0a5b274a-1c69-4c4c-b414-35a60ec22e9d req-66d8d648-daa4-47fe-9e6d-38f5b9805b65 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415406
May 20 16:21:58.187797 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812119e0-bbf6-4517-91b7-1d16baad22f3 req-71b9a392-758e-48a4-916d-f3243e4cdccc tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:58.189167 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-812119e0-bbf6-4517-91b7-1d16baad22f3 req-71b9a392-758e-48a4-916d-f3243e4cdccc tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.0785003
May 20 16:21:58.238335 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-812119e0-bbf6-4517-91b7-1d16baad22f3 req-dcbb936b-6fce-4f83-b01e-0918d403ae14 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431311
May 20 16:21:58.513650 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da732a6-0c50-4cd9-aa15-141375d58c88 req-7355c211-c4a2-43f5-8135-4008a9583dd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:58.515119 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1da732a6-0c50-4cd9-aa15-141375d58c88 req-7355c211-c4a2-43f5-8135-4008a9583dd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0807879
May 20 16:21:58.560570 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1da732a6-0c50-4cd9-aa15-141375d58c88 req-d4c0419e-044c-48c9-bbd0-a8dd77864e78 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396326
May 20 16:21:58.760556 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dba3813-c0d4-4e2d-8e27-87834df84dc7 req-cc3dc40c-0529-4dfb-806b-ecd1608562b6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:58.762277 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7dba3813-c0d4-4e2d-8e27-87834df84dc7 req-cc3dc40c-0529-4dfb-806b-ecd1608562b6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0971181
May 20 16:21:58.810879 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7dba3813-c0d4-4e2d-8e27-87834df84dc7 req-3c64b8d4-f734-4283-b460-45100d836b23 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410986
May 20 16:21:59.303230 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:21:59.370902 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-8925e95c-ccf8-4da3-9ee9-145004713a0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:59.372413 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-8925e95c-ccf8-4da3-9ee9-145004713a0c service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1369023
May 20 16:21:59.381055 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb24fb0-df53-43fc-959f-1532cddeb2dd req-57a5563a-7233-4287-a081-5fb32cfdd723 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:59.382484 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6cb24fb0-df53-43fc-959f-1532cddeb2dd req-57a5563a-7233-4287-a081-5fb32cfdd723 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=04ea77fcf30a4817bec5800ecff20065&device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 1100 time: 0.0865800
May 20 16:21:59.437860 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1aa770f-c928-4748-93e0-ab9120a8871e req-a5667ced-f045-4116-9527-5ff899cf6dad tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:59.439548 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c1aa770f-c928-4748-93e0-ab9120a8871e req-a5667ced-f045-4116-9527-5ff899cf6dad tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.0820765
May 20 16:21:59.441411 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6cb24fb0-df53-43fc-959f-1532cddeb2dd req-ae9a70f7-6eec-486f-a74d-46163201fd7d service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=04ea77fcf30a4817bec5800ecff20065&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0380619
May 20 16:21:59.492001 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c1aa770f-c928-4748-93e0-ab9120a8871e req-c49d5bdc-4c78-4d23-9260-8db8be1add98 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448871
May 20 16:21:59.719550 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-6c73eea0-e55b-4fc6-9731-db2973824cb8 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3360949
May 20 16:21:59.728938 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac827f4-e401-4762-bdd8-84950e54fa24 req-27b529fb-bb05-41c5-a794-fb901ce857af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:59.730415 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ac827f4-e401-4762-bdd8-84950e54fa24 req-27b529fb-bb05-41c5-a794-fb901ce857af service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1098 time: 0.1220222
May 20 16:21:59.773135 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb24fb0-df53-43fc-959f-1532cddeb2dd req-572e208c-9da0-448b-a812-5a8d733b5b7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:59.774584 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-6cb24fb0-df53-43fc-959f-1532cddeb2dd req-572e208c-9da0-448b-a812-5a8d733b5b7f service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.3254719
May 20 16:21:59.790884 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0ac827f4-e401-4762-bdd8-84950e54fa24 req-1d144c91-474f-471b-a8a6-a3c7992ba2c4 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0486653
May 20 16:21:59.806300 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4012d0-9ad8-47f0-90ab-b74f7b88160a req-2b7261d6-222e-4494-b9ab-65ac63a18b1d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:21:59.807837 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-df4012d0-9ad8-47f0-90ab-b74f7b88160a req-2b7261d6-222e-4494-b9ab-65ac63a18b1d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1252575
May 20 16:21:59.862101 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-df4012d0-9ad8-47f0-90ab-b74f7b88160a req-07d85409-1e7a-431b-986a-867f97c89e03 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0480120
May 20 16:21:59.876981 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-96372cc2-09bc-4531-88fa-a52ea93998b8 req-74694400-2970-4582-9055-1cb8781f1fdb service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1487536
May 20 16:22:00.008474 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adfb85d-583d-4d85-9024-35151f365f48 req-de4aa169-9a4a-473d-b80e-72ec4a69093b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.009973 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9adfb85d-583d-4d85-9024-35151f365f48 req-de4aa169-9a4a-473d-b80e-72ec4a69093b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0803752
May 20 16:22:00.054556 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9adfb85d-583d-4d85-9024-35151f365f48 req-cecdd5c0-5569-483b-8bbf-b958cc819c57 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389240
May 20 16:22:00.208782 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-cfabd40e-8905-496e-8043-470a6fcc7e97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.210543 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-cfabd40e-8905-496e-8043-470a6fcc7e97 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=04ea77fcf30a4817bec5800ecff20065&device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 1100 time: 0.0726306
May 20 16:22:00.281012 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-33db3dc6-f45f-4637-a0ad-29f360ab6e1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.289897 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-33db3dc6-f45f-4637-a0ad-29f360ab6e1a service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1096 time: 0.0765586
May 20 16:22:00.297973 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-6009d673-384b-4ae0-8d3d-cadb057eacc3 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.40&port_id=2c8d7819-4077-463a-a3bc-0dcb0497beeb HTTP/1.1" status: 200  len: 217 time: 0.0653839
May 20 16:22:00.371278 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7244c305-5b6a-42b8-b265-3b9b42e9c0a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.372902 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-7244c305-5b6a-42b8-b265-3b9b42e9c0a6 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=c1eae10b-39b6-4f33-8f12-5a3e9efa6216 HTTP/1.1" status: 200  len: 843 time: 0.0600326
May 20 16:22:00.443639 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-63f90ddc-8392-4bb2-9174-04a3e1fd9c50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.445469 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-63f90ddc-8392-4bb2-9174-04a3e1fd9c50 service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1305528
May 20 16:22:00.456176 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-1e88eeab-3b8f-46a7-9207-b2c256b0c01f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.456176 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-1e88eeab-3b8f-46a7-9207-b2c256b0c01f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=81e1d97d-8a33-4044-83b4-907740b1aca7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1179 time: 0.0744407
May 20 16:22:00.556229 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-65a4c8ca-e59e-4f2f-be2f-f3480f84419e service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 998 time: 0.1039076
May 20 16:22:00.608012 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-2b494784-15d9-4515-8c8e-7b2fb028b2f3 service neutron] 10.222.0.16 "GET /v2.0/networks/81e1d97d-8a33-4044-83b4-907740b1aca7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1441646
May 20 16:22:00.623505 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-d14bf020-19d4-4333-89be-c0a02fe1956d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.624872 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-d14bf020-19d4-4333-89be-c0a02fe1956d service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0611858
May 20 16:22:00.747085 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-bd0cc87b-a07b-4b21-9925-51789e9c8f77 req-53af0bd6-248d-4e62-9437-c98161a8e909 service neutron] 10.222.0.16 "GET /v2.0/networks/81e1d97d-8a33-4044-83b4-907740b1aca7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1321654
May 20 16:22:00.776288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-25a24af1-634d-4fd3-9529-adb475eaf409 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.778001 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-25a24af1-634d-4fd3-9529-adb475eaf409 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1458507
May 20 16:22:00.786866 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4afa87e4-08cb-4495-8cb1-a95f77af1f2a req-52f39143-7e9c-44e2-a0b8-c6b88b641a74 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:00.788314 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4afa87e4-08cb-4495-8cb1-a95f77af1f2a req-52f39143-7e9c-44e2-a0b8-c6b88b641a74 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.1233222
May 20 16:22:00.926858 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4afa87e4-08cb-4495-8cb1-a95f77af1f2a req-f274fb34-6c51-42a8-a12b-0a4c0e57da78 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1196795
May 20 16:22:00.963156 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-cb2edc04-c2a5-4bdf-9863-127b7cc3691b service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1730618
May 20 16:22:01.306177 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac1d338d-92ec-414d-840a-2310ec3e48a6 req-67357a63-f642-43ae-b25a-9f439d4f9049 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3355460
May 20 16:22:01.326257 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e25c9cfe-861e-46f4-a738-8ca5364274a7 req-7cbbd6c0-6728-4ff3-82a2-aaeb42c801e5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:01.333277 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e25c9cfe-861e-46f4-a738-8ca5364274a7 req-7cbbd6c0-6728-4ff3-82a2-aaeb42c801e5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.3361683
May 20 16:22:01.343481 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c0a982-55b1-473b-a571-ff53b92d1018 req-a6e71a87-0345-4084-993d-826575fd4359 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:01.343481 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-33c0a982-55b1-473b-a571-ff53b92d1018 req-a6e71a87-0345-4084-993d-826575fd4359 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1469171
May 20 16:22:01.410397 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e25c9cfe-861e-46f4-a738-8ca5364274a7 req-fae04f17-e7a3-44bd-977c-99e4a33339f7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0672812
May 20 16:22:01.421744 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-33c0a982-55b1-473b-a571-ff53b92d1018 req-36a03c9b-d3e1-43df-86d4-ce601c3fe39c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0624764
May 20 16:22:02.124890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891700f4-559c-42aa-9807-ed1ee49cba1e req-50214ff0-f384-47b4-8d4b-e081fe9d46ff tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:02.126365 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-891700f4-559c-42aa-9807-ed1ee49cba1e req-50214ff0-f384-47b4-8d4b-e081fe9d46ff tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.0826442
May 20 16:22:02.177885 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-891700f4-559c-42aa-9807-ed1ee49cba1e req-e03a7ab4-8d19-4dfb-9cbf-5ff484bc99ee tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440810
May 20 16:22:02.667960 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50f4b8d8-dcab-4ea2-ac44-dfbff19949c1 req-948cbd98-a331-461c-b919-1b80b1931c5d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:02.669439 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-50f4b8d8-dcab-4ea2-ac44-dfbff19949c1 req-948cbd98-a331-461c-b919-1b80b1931c5d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1415470
May 20 16:22:02.678972 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12d095f-cfb4-49bb-95d1-2947e8cb50ec req-cdbbd9f8-3bf3-4d32-8c2c-e1226812ce3f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:02.680386 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b12d095f-cfb4-49bb-95d1-2947e8cb50ec req-cdbbd9f8-3bf3-4d32-8c2c-e1226812ce3f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1509578
May 20 16:22:02.751143 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-50f4b8d8-dcab-4ea2-ac44-dfbff19949c1 req-40e9893e-6d12-452b-82a2-fe6ff16e7cd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0697451
May 20 16:22:02.755627 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b12d095f-cfb4-49bb-95d1-2947e8cb50ec req-5157ef6d-84ff-4d87-82c5-f30738bf3328 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0607636
May 20 16:22:02.945548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f491cbe3-35f8-49de-b09d-5689abe883e8 req-2991a2f3-fadd-4f55-801b-4160f5fb4fcd tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:02.947058 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f491cbe3-35f8-49de-b09d-5689abe883e8 req-2991a2f3-fadd-4f55-801b-4160f5fb4fcd tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0833726
May 20 16:22:02.995547 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f491cbe3-35f8-49de-b09d-5689abe883e8 req-63236d8b-8f84-456e-b5b5-c18a68924bd2 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423551
May 20 16:22:03.018523 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35762) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:03.254661 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-542950f5-d392-4979-b7fe-7e4677afb477 tempest-TestShelveInstance-1254566976 tempest-TestShelveInstance-1254566976-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:03.256219 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-542950f5-d392-4979-b7fe-7e4677afb477 tempest-TestShelveInstance-1254566976 tempest-TestShelveInstance-1254566976-project-admin] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1093 time: 0.2364883
May 20 16:22:03.259165 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35772) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:03.266093 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'port_id': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'fixed_ip_address': '172.20.0.3'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:22:03.272386 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:03.276551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Usage tracker for resource:floatingip and tenant:b05498ab061b462e9f28e7d5e6bff55e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:03.279573 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:03.285506 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:03.355553 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for floatingip, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:03.415312 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ae4bee-cee3-4139-8e7f-f0f2672bb441 req-4e3f9d25-30a3-4873-b094-5b23a73c804b tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:03.416836 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-88ae4bee-cee3-4139-8e7f-f0f2672bb441 req-4e3f9d25-30a3-4873-b094-5b23a73c804b tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.1215577
May 20 16:22:03.526138 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-88ae4bee-cee3-4139-8e7f-f0f2672bb441 req-7b942946-bb18-415d-bb73-a859def86f3e tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1034276
May 20 16:22:03.550198 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:03.684476 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Allocated IP 172.27.0.191 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/c5aab4f2-c066-45cd-b561-0df23db333c9) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:22:03.839341 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:03.942855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab279da-18c0-42fb-b9b8-efc699fda9a5 req-71c326ad-d801-47d5-917a-3899347142e9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:03.944899 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ab279da-18c0-42fb-b9b8-efc699fda9a5 req-71c326ad-d801-47d5-917a-3899347142e9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0823731
May 20 16:22:03.966300 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:03.975472 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:04.053215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:22:04.057805 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:04.063128 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:22:04.091772 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ab279da-18c0-42fb-b9b8-efc699fda9a5 req-f255a9ae-6a78-4708-b965-5ca5a277650f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1410987
May 20 16:22:04.097976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'Port': ['ID=c5aab4f2-c066-45cd-b561-0df23db333c9,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:04.104289 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:04.576284 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:04.740217 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:04.813627 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec61b96-c33e-4079-b5b3-25864718aebb req-0844b915-fd3e-4e88-b2de-4d7db8910f35 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:04.815043 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ec61b96-c33e-4079-b5b3-25864718aebb req-0844b915-fd3e-4e88-b2de-4d7db8910f35 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.1820061
May 20 16:22:04.954955 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ec61b96-c33e-4079-b5b3-25864718aebb req-fe8b7574-3618-4e67-be49-01a70f4c6b88 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1329045
May 20 16:22:05.016478 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:05.126472 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:05.131111 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:05.281682 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event updated for resources: {'Port': ['ID=c5aab4f2-c066-45cd-b561-0df23db333c9,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:05.287340 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:05.297308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:05.474030 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ec84f1-8dab-4f48-8d90-acbd712ac5e3 req-e559d640-9725-4d57-8062-3a68ff5b537f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:05.475598 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-84ec84f1-8dab-4f48-8d90-acbd712ac5e3 req-e559d640-9725-4d57-8062-3a68ff5b537f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.2615490
May 20 16:22:05.507533 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Floating IP f52a7162-c47a-4649-a5da-517923e725fb associated. External IP: 172.27.0.191, port: df15e363-aade-4bfb-9359-102c4aa7cae5.
May 20 16:22:05.605417 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-84ec84f1-8dab-4f48-8d90-acbd712ac5e3 req-f806b7f9-b542-472a-bf73-8bffb2298d7f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1223755
May 20 16:22:05.986202 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Router b2d11483-140f-49b3-9fa7-56159859e29c has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:22:06.226175 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:22:06.236134 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] Sync routers for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:22:06.247489 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:22:06.248563 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712469040>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:21:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:06.254721 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd84ca3a-1f26-4afa-9f2c-725b12520279 req-985f988d-e0d3-40f1-8be9-3069fd3af671 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:06.256340 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fd84ca3a-1f26-4afa-9f2c-725b12520279 req-985f988d-e0d3-40f1-8be9-3069fd3af671 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.1927021
May 20 16:22:06.309169 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fd84ca3a-1f26-4afa-9f2c-725b12520279 req-7f4ade74-129e-4aed-9069-43df5d4826bd tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462196
May 20 16:22:06.331361 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:06.388244 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.1279953
May 20 16:22:06.389075 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:22:06.433362 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:22:06.570524 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'status': 'completed', 'code': 200}
May 20 16:22:06.789661 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712469040>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': 'f52a7162-c47a-4649-a5da-517923e725fb', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'floating_ip_address': '172.27.0.191', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'port_id': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'mac_address': 'fa:16:3e:b7:cd:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:22:04Z', 'updated_at': '2021-05-20T16:22:04Z', 'revision_number': 0, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 5, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:06.793673 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] Checking router: b2d11483-140f-49b3-9fa7-56159859e29c for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:22:06.802500 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:22:06.803698 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712469040>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:21:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:06.803865 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9837653-aed1-4427-b852-d02f8b991f4c req-0c658b92-ecae-451d-8896-89a20daf451e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:06.805471 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f9837653-aed1-4427-b852-d02f8b991f4c req-0c658b92-ecae-451d-8896-89a20daf451e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0852425
May 20 16:22:06.859722 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f9837653-aed1-4427-b852-d02f8b991f4c req-1f939ae7-4e5a-48e5-9ba3-cf72701b75bd tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0476348
May 20 16:22:07.020890 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:22:07.379075 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712469040>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': 'f52a7162-c47a-4649-a5da-517923e725fb', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'floating_ip_address': '172.27.0.191', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'port_id': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'mac_address': 'fa:16:3e:b7:cd:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:22:04Z', 'updated_at': '2021-05-20T16:22:04Z', 'revision_number': 0, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 5, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:07.383456 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac19c5ad-da8f-4cbe-a9b6-4f0e78cdd4ef None None] The sync data for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi is: [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': 'f52a7162-c47a-4649-a5da-517923e725fb', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'floating_ip_address': '172.27.0.191', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'port_id': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'mac_address': 'fa:16:3e:b7:cd:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:22:04Z', 'updated_at': '2021-05-20T16:22:04Z', 'revision_number': 0, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 5, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:22:07.507073 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3db50f1-5d97-49cf-8f46-9e643d5ddf62 req-402823bc-b63e-4a72-a042-bdbb6240dfd8 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:07.508637 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d3db50f1-5d97-49cf-8f46-9e643d5ddf62 req-402823bc-b63e-4a72-a042-bdbb6240dfd8 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.0879996
May 20 16:22:07.556691 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d3db50f1-5d97-49cf-8f46-9e643d5ddf62 req-db302aad-5a6b-4b12-9a47-b84c4e44b1ed tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419083
May 20 16:22:07.575630 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76870259-a7c4-4a46-8ae4-33f44a39da42 None None] New status for floating IP f52a7162-c47a-4649-a5da-517923e725fb: ACTIVE {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:22:08.058511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec003e1-99ba-4c62-84e8-68ec55d854d1 req-9bbf86a4-04da-4616-bc30-1b678a4c3732 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:08.060007 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ec003e1-99ba-4c62-84e8-68ec55d854d1 req-9bbf86a4-04da-4616-bc30-1b678a4c3732 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0848241
May 20 16:22:08.105403 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3ec003e1-99ba-4c62-84e8-68ec55d854d1 req-d48f175f-8123-42db-bc6f-19deb6fa2c37 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394897
May 20 16:22:08.139644 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:22:08.241551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-51c07835-0f7d-4384-86d3-de651a8c547b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:08.243224 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-51c07835-0f7d-4384-86d3-de651a8c547b service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1098 time: 0.0795164
May 20 16:22:08.388612 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-bc7eacd2-71a2-4962-a8ad-036a35eda865 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:08.390360 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-bc7eacd2-71a2-4962-a8ad-036a35eda865 service neutron] 10.222.0.16 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 910 time: 0.1404536
May 20 16:22:08.498563 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-4b441e06-d082-42e7-890f-0e6eb76ad1dd service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 1001 time: 0.1015880
May 20 16:22:08.562262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-d6177bc5-dd8f-4fc7-b55c-17e6dd070500 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:08.563832 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-d6177bc5-dd8f-4fc7-b55c-17e6dd070500 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 200  len: 848 time: 0.0591669
May 20 16:22:08.656775 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-45ddb127-885c-473b-8464-62ed00528fd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:08.659119 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-45ddb127-885c-473b-8464-62ed00528fd9 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=39834042-f759-400b-9bc0-eb7c7abdd5c0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0887668
May 20 16:22:08.861259 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-a9625fd0-16f8-4bca-8da2-f07a023903df service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1952581
May 20 16:22:08.872236 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2244ff-f671-4e35-afa7-241e9e697f08 req-242536db-5826-47d7-a77a-2904d699be8e tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:08.873625 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cc2244ff-f671-4e35-afa7-241e9e697f08 req-242536db-5826-47d7-a77a-2904d699be8e tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.1881549
May 20 16:22:08.924199 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cc2244ff-f671-4e35-afa7-241e9e697f08 req-e025b4be-77f8-4ac5-b265-fd6d2f790ece tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445380
May 20 16:22:09.147175 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-809b0272-aac4-4e87-956a-3ba56364b1f2 req-f0d067fd-025a-4d2b-9ded-135a2956a309 service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2179708
May 20 16:22:09.315271 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3bf3e23-683b-464b-957d-4545a84352f2 req-0239e8a2-65ed-4a3d-b919-eedf7f4d10a0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:09.315271 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b3bf3e23-683b-464b-957d-4545a84352f2 req-0239e8a2-65ed-4a3d-b919-eedf7f4d10a0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0930638
May 20 16:22:09.361707 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b3bf3e23-683b-464b-957d-4545a84352f2 req-67734c17-31d4-47a0-b518-a966761ada71 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410676
May 20 16:22:10.117792 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a28769-ddc7-41c5-b837-5275e44438e2 req-8538422d-bd0b-4fce-a72c-003eb98375e5 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:10.119331 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75a28769-ddc7-41c5-b837-5275e44438e2 req-8538422d-bd0b-4fce-a72c-003eb98375e5 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.0839229
May 20 16:22:10.164971 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75a28769-ddc7-41c5-b837-5275e44438e2 req-4c18439a-e5cb-46f9-999d-e6dcf61c3799 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398412
May 20 16:22:11.261244 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 2c8d7819-4077-463a-a3bc-0dcb0497beeb details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:22:11.373869 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd7d53a-4b71-4a43-af9a-0e9a248d7f95 req-65064905-e285-4a68-95c4-42dc20ed8de6 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:11.382050 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9dd7d53a-4b71-4a43-af9a-0e9a248d7f95 req-65064905-e285-4a68-95c4-42dc20ed8de6 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 947 time: 0.1004872
May 20 16:22:11.406163 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 2c8d7819-4077-463a-a3bc-0dcb0497beeb, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=2c8d7819-4077-463a-a3bc-0dcb0497beeb,segment=NetworkSegment(b6d80164-e565-4ad3-a39d-687326b982c6),segment_id=b6d80164-e565-4ad3-a39d-687326b982c6)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:11.420467 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '2c8d7819-4077-463a-a3bc-0dcb0497beeb', 'network_id': '81e1d97d-8a33-4044-83b4-907740b1aca7', 'port_id': '2c8d7819-4077-463a-a3bc-0dcb0497beeb', 'mac_address': 'fa:16:3e:7c:9f:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 619, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c1eae10b-39b6-4f33-8f12-5a3e9efa6216', 'ip_address': '192.168.233.40'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:22:11.431570 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9dd7d53a-4b71-4a43-af9a-0e9a248d7f95 req-202ac1b7-cfeb-4a23-b592-23587876d816 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436318
May 20 16:22:11.479470 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:11.496332 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2c8d7819-4077-463a-a3bc-0dcb0497beeb {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:22:11.517260 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 2c8d7819-4077-463a-a3bc-0dcb0497beeb, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=2c8d7819-4077-463a-a3bc-0dcb0497beeb,segment=NetworkSegment(b6d80164-e565-4ad3-a39d-687326b982c6),segment_id=b6d80164-e565-4ad3-a39d-687326b982c6)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:11.612040 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:11.613856 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:11.708253 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=2c8d7819-4077-463a-a3bc-0dcb0497beeb,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:11.721137 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173edb03-36ff-4979-806f-3112a224ba5c req-4ee4dded-9e3d-4424-91f1-fa9e4a71f5cf tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:11.723034 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-173edb03-36ff-4979-806f-3112a224ba5c req-4ee4dded-9e3d-4424-91f1-fa9e4a71f5cf tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1198301
May 20 16:22:11.730548 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:11.776061 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-173edb03-36ff-4979-806f-3112a224ba5c req-d9cff612-2237-4202-9534-b93c980093d1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0456114
May 20 16:22:12.014032 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['2c8d7819-4077-463a-a3bc-0dcb0497beeb'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:22:12.251527 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35914) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:12.378051 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-0ee8216f-649a-43d5-bd53-d820ed5774e2 service neutron] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1250784
May 20 16:22:12.635537 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16052d3a-1eee-4630-9d43-87f97fb94ccf req-3c775ea0-c868-4e46-9541-17446f49d196 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:12.637100 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-16052d3a-1eee-4630-9d43-87f97fb94ccf req-3c775ea0-c868-4e46-9541-17446f49d196 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 948 time: 0.0887246
May 20 16:22:12.689767 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-16052d3a-1eee-4630-9d43-87f97fb94ccf req-619204a0-413b-48ac-ba27-58b046257ad0 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413682
May 20 16:22:12.992920 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f045ecb-62da-4603-b134-ba672fc9eac7 req-cb9fe075-d91c-42c0-b2dd-953d59dc3a94 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:12.994400 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5f045ecb-62da-4603-b134-ba672fc9eac7 req-cb9fe075-d91c-42c0-b2dd-953d59dc3a94 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0808773
May 20 16:22:13.050385 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5f045ecb-62da-4603-b134-ba672fc9eac7 req-681bfb7b-7a75-4160-837b-6bda83166bda tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0501254
May 20 16:22:13.268905 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 2c8d7819-4077-463a-a3bc-0dcb0497beeb up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:22:13.422607 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 2c8d7819-4077-463a-a3bc-0dcb0497beeb completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:22:13.428648 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 2c8d7819-4077-463a-a3bc-0dcb0497beeb triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:13.429012 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:13.546475 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:13.574051 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2c8d7819-4077-463a-a3bc-0dcb0497beeb'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:22:13.583447 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 2c8d7819-4077-463a-a3bc-0dcb0497beeb, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=2c8d7819-4077-463a-a3bc-0dcb0497beeb,segment=NetworkSegment(b6d80164-e565-4ad3-a39d-687326b982c6),segment_id=b6d80164-e565-4ad3-a39d-687326b982c6)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:13.622012 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2c8d7819-4077-463a-a3bc-0dcb0497beeb', 'code': 200}
May 20 16:22:13.726893 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:13.729155 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-908878de-fce2-4411-bfee-bd66828cde2f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:13.796809 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=2c8d7819-4077-463a-a3bc-0dcb0497beeb,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:13.803324 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:13.892435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302d5681-d97f-425c-b65a-5da4a68c0818 req-c04984cc-4211-43eb-8268-4f2073611803 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:13.894988 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-302d5681-d97f-425c-b65a-5da4a68c0818 req-c04984cc-4211-43eb-8268-4f2073611803 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0939579
May 20 16:22:13.944229 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-302d5681-d97f-425c-b65a-5da4a68c0818 req-1ccad75b-f048-4125-a22a-fa4db1cd4ede tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432634
May 20 16:22:14.135277 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6a5c28-23bb-4195-a1ce-0c230a4068b5 req-844ceae6-18d6-4a44-9be6-5da35556cc34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:14.136786 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6a6a5c28-23bb-4195-a1ce-0c230a4068b5 req-844ceae6-18d6-4a44-9be6-5da35556cc34 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 1102 time: 0.0765705
May 20 16:22:14.211564 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6a6a5c28-23bb-4195-a1ce-0c230a4068b5 req-ed38b4d7-b46b-4c76-84e2-809bb7ee5daf service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0679457
May 20 16:22:14.261909 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc448509-a98b-4447-9933-2863cd0ab322 req-61110da6-6a3d-4fc4-b802-357c5fd4ea92 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:14.263591 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc448509-a98b-4447-9933-2863cd0ab322 req-61110da6-6a3d-4fc4-b802-357c5fd4ea92 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0853863
May 20 16:22:14.308360 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc448509-a98b-4447-9933-2863cd0ab322 req-b9d2e365-1123-4fe1-b5f9-bd202f015d86 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389366
May 20 16:22:15.136290 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18eb4bc9-bcfa-4bb4-898d-6b8553886a7d req-bf899d35-cdd6-4763-8656-b73666256181 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:15.137690 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-18eb4bc9-bcfa-4bb4-898d-6b8553886a7d req-bf899d35-cdd6-4763-8656-b73666256181 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0845053
May 20 16:22:15.183021 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-18eb4bc9-bcfa-4bb4-898d-6b8553886a7d req-7d933f54-54ef-4af6-a3c4-48faa8764806 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395377
May 20 16:22:15.585659 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb61b196-cbf8-495f-b21e-fd383ec0a7ec req-77a87ba4-b49e-403f-b09a-38444cb9ea8e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:15.587157 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb61b196-cbf8-495f-b21e-fd383ec0a7ec req-77a87ba4-b49e-403f-b09a-38444cb9ea8e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0872307
May 20 16:22:15.592253 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 35970) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:15.698339 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb61b196-cbf8-495f-b21e-fd383ec0a7ec req-a3fbec50-ceb5-4b76-bdac-035ee3038ac4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1001084
May 20 16:22:15.733687 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:15.759848 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8034b166-6333-4182-a1c9-ed72874efe31 req-f8abbae6-5cb9-4969-a5e9-22be5922cb9e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:15.761231 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8034b166-6333-4182-a1c9-ed72874efe31 req-f8abbae6-5cb9-4969-a5e9-22be5922cb9e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 945 time: 0.1381338
May 20 16:22:15.762242 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:15.766575 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Usage tracker for resource:security_group_rule and tenant:b53d66a633664adaa92aa40b1aedec1d is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:15.771286 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:15.790064 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:15.837143 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8034b166-6333-4182-a1c9-ed72874efe31 req-1586bbfd-ce2c-419b-a265-e98d266e40c1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0675550
May 20 16:22:15.902525 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ce676696-104c-4a69-ad26-6087da218eb2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:15.906922 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:16.051587 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:16.058494 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-801978ac-98f1-4c48-9278-835da9b4a9ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:16.101182 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=b53d66a633664adaa92aa40b1aedec1d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5078022
May 20 16:22:16.102151 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a55c8de1-7051-4b73-8fa3-174817163a7b,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:16.104037 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 35976) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:16.105528 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:16.164100 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:16.190822 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:16.308656 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:16.313506 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-16299550-11d3-416b-9df2-05a360d01c07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:16.326736 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a55c8de1-7051-4b73-8fa3-174817163a7b,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:16.335981 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.336342 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.336696 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.337045 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.337388 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.337751 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.338090 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.338431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.338766 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.339102 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.339455 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.339788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:16.342416 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:16.344903 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/a55c8de1-7051-4b73-8fa3-174817163a7b HTTP/1.1" status: 204  len: 168 time: 0.2378693
May 20 16:22:16.344903 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:16.420345 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-30daf1ce-068f-4a30-ad31-af8e9b7b1658 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:16.422306 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-30daf1ce-068f-4a30-ad31-af8e9b7b1658 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89&tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 1096 time: 0.1491668
May 20 16:22:16.430071 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e4485e-12aa-4f6f-8f66-383e711d2912 req-c1659227-fd56-44f6-b476-9507fb4fdfc1 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:16.431602 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3e4485e-12aa-4f6f-8f66-383e711d2912 req-c1659227-fd56-44f6-b476-9507fb4fdfc1 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.1279643
May 20 16:22:16.523435 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3e4485e-12aa-4f6f-8f66-383e711d2912 req-cfe4775d-fd0c-4a98-abb4-087df02ce5e3 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0850604
May 20 16:22:16.560613 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-66927873-5f31-4764-812d-086ca31bd819 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:16.562006 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-66927873-5f31-4764-812d-086ca31bd819 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1096 time: 0.0895586
May 20 16:22:16.821789 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-7b2c48d0-d41c-4171-82f9-e35ccb7e7d7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:16.822661 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-7b2c48d0-d41c-4171-82f9-e35ccb7e7d7c service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.2471430
May 20 16:22:16.979516 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-b790978c-b575-45a2-8661-e51804e4d23e service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 998 time: 0.1460080
May 20 16:22:17.042982 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aad02d-3b43-4b59-a666-5534ab057afd req-47d9a2a3-c45a-4085-92a3-11d81fb74607 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:17.044568 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2aad02d-3b43-4b59-a666-5534ab057afd req-47d9a2a3-c45a-4085-92a3-11d81fb74607 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1638064
May 20 16:22:17.089235 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-f8e98cf2-1cdd-4f38-8f3a-46d61bf50333 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:17.090740 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-f8e98cf2-1cdd-4f38-8f3a-46d61bf50333 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0983634
May 20 16:22:17.103963 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2aad02d-3b43-4b59-a666-5534ab057afd req-a47c66f4-5639-4c16-8c18-f202c2a48a2d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0533683
May 20 16:22:17.257235 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-8935e2ec-1453-4b98-a037-3bc593dc33c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:17.258897 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-8935e2ec-1453-4b98-a037-3bc593dc33c0 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1504643
May 20 16:22:17.429796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129b7898-1515-46b3-9e49-aa3130dc26d1 req-cbe7897c-0e45-4856-95d4-d87c2d647550 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:17.431142 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-129b7898-1515-46b3-9e49-aa3130dc26d1 req-cbe7897c-0e45-4856-95d4-d87c2d647550 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 945 time: 0.2594917
May 20 16:22:17.469193 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-7f219c4d-f6b3-43aa-8f8c-e5b9819c3e87 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1913745
May 20 16:22:17.476814 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf644ef-0d0e-4d09-9cc3-2473b18d6381 req-bbb31076-314b-48c5-b709-dd30aac23f33 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:17.478429 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf644ef-0d0e-4d09-9cc3-2473b18d6381 req-bbb31076-314b-48c5-b709-dd30aac23f33 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.2589238
May 20 16:22:17.562825 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-129b7898-1515-46b3-9e49-aa3130dc26d1 req-d391f046-9ec3-49f3-85ad-81d0727a1ac8 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/security-groups?id=2ea187d4-f820-42b0-b9c6-b541013c8cb4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1216297
May 20 16:22:17.628769 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf644ef-0d0e-4d09-9cc3-2473b18d6381 req-0a5cb466-f27f-496c-8c5b-60d2a79b9ceb tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1285684
May 20 16:22:17.664658 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f0dac8d-4c56-4f55-8664-efa274a087b0 req-6ef66b34-cbec-4093-822e-0ade71c7172b service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1832738
May 20 16:22:17.720328 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-e865423f-44cf-491f-b861-cd6fbce8b8ea tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:17.721061 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-e865423f-44cf-491f-b861-cd6fbce8b8ea tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Synchronizing usage tracker for tenant:685f156c43064dcf8880e8af97070ea9 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:22:17.799312 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-e865423f-44cf-491f-b861-cd6fbce8b8ea tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Unset dirty status for tenant:685f156c43064dcf8880e8af97070ea9 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:22:17.800480 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-e865423f-44cf-491f-b861-cd6fbce8b8ea tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 945 time: 0.1662676
May 20 16:22:17.942177 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Deleting port 93300f34-e9fe-4747-86be-148f099b326d {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:22:17.942443 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:18.079874 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] For port 93300f34-e9fe-4747-86be-148f099b326d, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=93300f34-e9fe-4747-86be-148f099b326d,segment=NetworkSegment(d381c96c-d9a4-4090-b7b0-51fe6ac531dd),segment_id=d381c96c-d9a4-4090-b7b0-51fe6ac531dd)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:18.080225 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:18.203939 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Calling delete_port for 93300f34-e9fe-4747-86be-148f099b326d owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:22:18.297175 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b8a6e8-294d-4166-adae-5cc43e672abf req-8f1b9bd9-4a89-4004-a662-41633c02d6c6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:18.298733 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-30b8a6e8-294d-4166-adae-5cc43e672abf req-8f1b9bd9-4a89-4004-a662-41633c02d6c6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0831001
May 20 16:22:18.351786 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-30b8a6e8-294d-4166-adae-5cc43e672abf req-399cd789-9277-446b-a7af-adf5af416724 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0468426
May 20 16:22:18.423802 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:18.526443 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:18.539046 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['93300f34-e9fe-4747-86be-148f099b326d'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:22:18.542777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9cce9bf2-53c2-480a-a7cc-345a61420947 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:18.619521 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Pushing event deleted for resources: {'Port': ['ID=93300f34-e9fe-4747-86be-148f099b326d,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:18.631297 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:18.670404 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] No DVR routers for this DVR port 93300f34-e9fe-4747-86be-148f099b326d on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:22:18.678514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:18.678992 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94758bc3-9989-4360-b228-8f3243a7f897', 'name': 'network-vif-deleted', 'tag': '93300f34-e9fe-4747-86be-148f099b326d'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:22:18.714118 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-63e1be8e-1b5f-41e0-af72-935108444212 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:18.767842 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4b8688a3-dcd1-429c-866d-43cb997fe523 req-378fdf48-30c1-4644-9f84-1ad1cdb40fe1 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0515146
May 20 16:22:18.771925 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba9dee4e-bf31-409b-9d9e-1553e7838a7f req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.16 "DELETE /v2.0/ports/93300f34-e9fe-4747-86be-148f099b326d HTTP/1.1" status: 204  len: 173 time: 0.9630804
May 20 16:22:18.868741 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a8ed75-8702-4356-8788-7f4277e84cdb req-98170873-ce7e-4e12-aabc-e0a87f507747 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:18.870531 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b7a8ed75-8702-4356-8788-7f4277e84cdb req-98170873-ce7e-4e12-aabc-e0a87f507747 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0943320
May 20 16:22:18.922639 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b7a8ed75-8702-4356-8788-7f4277e84cdb req-178d5184-040d-45a8-9e9f-bbdc099016ed tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454493
May 20 16:22:18.986599 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94758bc3-9989-4360-b228-8f3243a7f897', 'name': 'network-vif-deleted', 'tag': '93300f34-e9fe-4747-86be-148f099b326d', 'status': 'completed', 'code': 200}
May 20 16:22:19.608309 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7055036-1452-4c3c-8265-2beeac66c444 req-cd77eea6-5f83-4a75-afc9-3a28f6012a99 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:19.609847 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a7055036-1452-4c3c-8265-2beeac66c444 req-cd77eea6-5f83-4a75-afc9-3a28f6012a99 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0934706
May 20 16:22:19.617204 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:19.660307 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a7055036-1452-4c3c-8265-2beeac66c444 req-77767a87-8142-4f77-9b4a-10c163c5dff3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437016
May 20 16:22:19.929340 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aa1473c6-53d2-4839-a4db-c7ad9f169400 req-cd2396b5-bc3d-4905-97ea-bac8a5021e72 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0423355
May 20 16:22:20.121992 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce36e432-64ec-454e-9f02-f4e8b7ba499f req-5a8eb477-6692-43c8-96e5-6e0734d4290f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:20.123487 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ce36e432-64ec-454e-9f02-f4e8b7ba499f req-5a8eb477-6692-43c8-96e5-6e0734d4290f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0854609
May 20 16:22:20.169964 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ce36e432-64ec-454e-9f02-f4e8b7ba499f req-95d9bef1-aac0-42ee-9ccd-1e93126a1fe7 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406063
May 20 16:22:20.869012 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c813d4-dc67-4abe-9746-f06ef789095e req-15e9486e-1049-4d3f-89cb-2e634ea372b6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:20.870533 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-06c813d4-dc67-4abe-9746-f06ef789095e req-15e9486e-1049-4d3f-89cb-2e634ea372b6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0890625
May 20 16:22:20.919576 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-06c813d4-dc67-4abe-9746-f06ef789095e req-cea8db8d-5ce5-44f9-8f89-fe7041eec5a9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427756
May 20 16:22:21.092400 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fdac2566-d25e-4119-9482-f3016e4b327f req-b7ef49a7-65cb-4fa1-a843-375037e89c63 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0485795
May 20 16:22:21.262563 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:21.266559 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 93300f34-e9fe-4747-86be-148f099b326d no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:22:21.357617 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 93300f34-e9fe-4747-86be-148f099b326d {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:22:21.357967 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 93300f34-e9fe-4747-86be-148f099b326d not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:22:21.374451 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5ab5fe-01ef-4ecd-a90e-fdabff92a9cf req-ce9bd5b8-fee2-4d75-b067-af694683c861 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:21.376008 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fe5ab5fe-01ef-4ecd-a90e-fdabff92a9cf req-ce9bd5b8-fee2-4d75-b067-af694683c861 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0887799
May 20 16:22:21.426070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fe5ab5fe-01ef-4ecd-a90e-fdabff92a9cf req-691a55a6-da98-4c2b-98f6-f24c0c513c2c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409691
May 20 16:22:22.223428 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2816fcb2-3248-4ee8-8dfc-56ff8cc6a3e2 req-301661b2-0535-4d77-9e92-7bc3061f25e7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:22.226211 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2816fcb2-3248-4ee8-8dfc-56ff8cc6a3e2 req-301661b2-0535-4d77-9e92-7bc3061f25e7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1841002
May 20 16:22:22.278546 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2816fcb2-3248-4ee8-8dfc-56ff8cc6a3e2 req-3f3f666c-7a54-4266-9aab-fa54f0964705 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0449584
May 20 16:22:22.433011 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c34accc5-8373-46e5-a237-d5539b939139 req-6a4155cb-c684-46fa-a60b-d0ecfc101341 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0485318
May 20 16:22:22.621086 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f8ecda3-632a-4c82-afae-20e500e3958a req-1e96479c-3682-446d-b755-761785043a46 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:22.622589 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1f8ecda3-632a-4c82-afae-20e500e3958a req-1e96479c-3682-446d-b755-761785043a46 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0814433
May 20 16:22:22.670791 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1f8ecda3-632a-4c82-afae-20e500e3958a req-e35e7955-a07b-4b74-bd51-9d020299c008 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421672
May 20 16:22:23.495706 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18ea260-0cbb-40f6-b958-eab3c0f41fb9 req-4f622589-e6c7-46bd-a359-7c5eb0c5eefd tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:23.516031 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e18ea260-0cbb-40f6-b958-eab3c0f41fb9 req-4f622589-e6c7-46bd-a359-7c5eb0c5eefd tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1176252
May 20 16:22:23.567330 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e18ea260-0cbb-40f6-b958-eab3c0f41fb9 req-e2d5e163-fbf6-4ed1-838f-c2f88e938a5e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0504594
May 20 16:22:23.741780 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8a61cbec-6bef-4de3-acc3-2f1d4cb372b2 req-4391c952-508c-44e5-821d-5f8b5732ee06 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0462682
May 20 16:22:23.931832 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab41ed0-8ab7-49bb-a2ed-1a5f00760727 req-5cbb6324-9190-43cf-8af1-9bd961c1dc88 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:23.933358 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8ab41ed0-8ab7-49bb-a2ed-1a5f00760727 req-5cbb6324-9190-43cf-8af1-9bd961c1dc88 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0847366
May 20 16:22:23.988427 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8ab41ed0-8ab7-49bb-a2ed-1a5f00760727 req-95544876-e6a5-4af6-98c3-7715a1d3fedd tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489433
May 20 16:22:24.915809 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d8bc236-2807-49b6-becc-096b3e15bb7f req-3f0de246-3366-48cb-bb16-868448df44ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:24.917212 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d8bc236-2807-49b6-becc-096b3e15bb7f req-3f0de246-3366-48cb-bb16-868448df44ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0859463
May 20 16:22:24.965685 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d8bc236-2807-49b6-becc-096b3e15bb7f req-aa3feb37-cec1-42c2-a85b-49c27e1ab4d3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0425999
May 20 16:22:25.122524 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-763bb319-c362-4bc1-a7c9-b26c36c6089f req-a2289d31-3501-45e4-9693-eba9fdd2cf6b tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0464971
May 20 16:22:25.322621 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a0f1ac-5abe-44bc-9b91-eeff315e174e req-4a762114-4f99-48ba-9d0c-30fdb876aac9 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:25.328603 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-09a0f1ac-5abe-44bc-9b91-eeff315e174e req-4a762114-4f99-48ba-9d0c-30fdb876aac9 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0870299
May 20 16:22:25.377671 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-09a0f1ac-5abe-44bc-9b91-eeff315e174e req-6f045434-6628-45ef-a5e2-96df22b81a73 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422649
May 20 16:22:26.172292 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc132b91-e703-4ca4-b9b5-354c53e4e188 req-28618eae-fbad-4c56-b3ea-df263f9a7e1d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:26.173780 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc132b91-e703-4ca4-b9b5-354c53e4e188 req-28618eae-fbad-4c56-b3ea-df263f9a7e1d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0893123
May 20 16:22:26.221680 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bc132b91-e703-4ca4-b9b5-354c53e4e188 req-5a683e39-4e3c-4b2a-8271-c1877a133faa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413380
May 20 16:22:26.378829 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f90eb332-6d15-4e9c-b4c7-9f285c60f604 req-ddab8a61-1e41-4169-9827-ee5b1a455e2c tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0465252
May 20 16:22:26.578417 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a9f7c7-6747-4722-af0c-7052af217c60 req-fa76bf9f-ab20-433a-a6ba-a8110849e6b1 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:26.580070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-93a9f7c7-6747-4722-af0c-7052af217c60 req-fa76bf9f-ab20-433a-a6ba-a8110849e6b1 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0880883
May 20 16:22:26.637344 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-93a9f7c7-6747-4722-af0c-7052af217c60 req-4394f639-769a-480a-89b2-981970390bb2 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467465
May 20 16:22:27.445823 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aadef260-62fc-48ee-b9ee-e5c71cc49493 req-2848c36f-3503-4e91-9f0f-6d49c6a81f96 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:27.501966 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aadef260-62fc-48ee-b9ee-e5c71cc49493 req-2848c36f-3503-4e91-9f0f-6d49c6a81f96 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1028123
May 20 16:22:27.501966 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aadef260-62fc-48ee-b9ee-e5c71cc49493 req-cbf15627-b571-4a65-9fb0-95aa91557e3f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0429413
May 20 16:22:27.648041 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a485580-d2d8-46c4-9682-114322137f3c req-fa7eb6e9-85ea-4f00-a9f7-1e49469546a7 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0479560
May 20 16:22:27.832090 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13050720-7a1c-49c1-956b-2c33cb435fde req-ca56f341-b0a5-49b4-ac57-1adf21decbb5 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:27.833584 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-13050720-7a1c-49c1-956b-2c33cb435fde req-ca56f341-b0a5-49b4-ac57-1adf21decbb5 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0827386
May 20 16:22:27.882840 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-13050720-7a1c-49c1-956b-2c33cb435fde req-78a764f2-c12a-4323-a2c2-6fd422146be6 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435922
May 20 16:22:27.967101 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:22:28.723097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b363a11b-b0be-42a3-8a44-8e4b9694d8d7 req-e93c7137-3f75-4204-8a2d-1435c4d2bd6f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:28.724768 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b363a11b-b0be-42a3-8a44-8e4b9694d8d7 req-e93c7137-3f75-4204-8a2d-1435c4d2bd6f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0898323
May 20 16:22:28.774240 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b363a11b-b0be-42a3-8a44-8e4b9694d8d7 req-ed4c495d-7877-470f-84eb-9e535e9b61f1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435026
May 20 16:22:28.922086 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-274299c0-9972-4a81-9d10-4897a3ddcb3a req-4ec5acda-8961-40a9-8906-247e081f763a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0457468
May 20 16:22:29.106827 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e22908c9-f9d1-401f-a12a-89cb0f25dac1 req-c81e3aba-aa5f-4913-b527-c47fc0d8126a tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:29.108362 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e22908c9-f9d1-401f-a12a-89cb0f25dac1 req-c81e3aba-aa5f-4913-b527-c47fc0d8126a tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0829053
May 20 16:22:29.162228 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e22908c9-f9d1-401f-a12a-89cb0f25dac1 req-3d3a9d23-83ca-4223-93fa-41d95b5a63c3 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471613
May 20 16:22:29.280540 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:29.976201 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1635c598-cafe-4f8b-9cc2-9840147fd475 req-c734db3a-4774-4476-bd70-aec514e63b7b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:29.977754 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1635c598-cafe-4f8b-9cc2-9840147fd475 req-c734db3a-4774-4476-bd70-aec514e63b7b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0831547
May 20 16:22:30.025326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1635c598-cafe-4f8b-9cc2-9840147fd475 req-cda4467a-4135-4eb7-bbfd-1ceaa9862b8d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415063
May 20 16:22:30.185129 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-be21dc8b-213a-4895-96ed-e46bfae9b1fa req-ef84f96f-3cdf-4736-9702-4271ecb64aa6 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0484409
May 20 16:22:30.365323 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75bf0413-4fb1-41aa-bde3-deb4d6ff5088 req-34d3367c-feed-4d35-9b0a-a8cba79225eb tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:30.366755 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75bf0413-4fb1-41aa-bde3-deb4d6ff5088 req-34d3367c-feed-4d35-9b0a-a8cba79225eb tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0823369
May 20 16:22:30.412873 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-75bf0413-4fb1-41aa-bde3-deb4d6ff5088 req-f4ed1725-022b-4227-8840-7850dfb9c0db tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402126
May 20 16:22:31.235357 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a86f15-88ca-4acb-8fb2-a7d45b2475b4 req-55afe15a-d4ee-4f83-a177-828a7b5cf78d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:31.237105 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f7a86f15-88ca-4acb-8fb2-a7d45b2475b4 req-55afe15a-d4ee-4f83-a177-828a7b5cf78d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0871513
May 20 16:22:31.361971 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f7a86f15-88ca-4acb-8fb2-a7d45b2475b4 req-d1ecb953-4d3d-4b5b-9f53-6ee4e4aa007b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1185305
May 20 16:22:31.502616 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b65f1820-1706-4a34-83cd-03356086ccb6 req-e77ba2cb-7d42-4766-9304-133703fe90d5 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0424514
May 20 16:22:31.680827 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84becb5-6c23-471d-874d-1a1b3fb512cd req-0f5cf8e3-0cfa-434a-980e-da1cbe20e11f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:31.682167 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a84becb5-6c23-471d-874d-1a1b3fb512cd req-0f5cf8e3-0cfa-434a-980e-da1cbe20e11f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0834427
May 20 16:22:31.727157 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a84becb5-6c23-471d-874d-1a1b3fb512cd req-7bd61181-9fa3-470e-983b-3a2d3ccb0798 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387743
May 20 16:22:32.556705 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335f7521-a1b3-4ce1-9ac2-f4787c8f4180 req-8cb3f548-1033-40f9-9e68-48d1b2b3510d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:32.558258 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-335f7521-a1b3-4ce1-9ac2-f4787c8f4180 req-8cb3f548-1033-40f9-9e68-48d1b2b3510d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0844109
May 20 16:22:32.603817 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-335f7521-a1b3-4ce1-9ac2-f4787c8f4180 req-7c95190d-203b-4cda-95f2-14b823400a1a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397363
May 20 16:22:32.746993 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ad32b73-9a7c-4bc0-a273-bbbc96436b76 req-ff641fc2-7302-4dd2-9ca8-c6185f5a94ce tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0450575
May 20 16:22:32.926226 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1e5d66f-e66d-4b39-b985-9160506f7d53 req-ce3156d6-1e81-46e2-9c1a-be920d3996af tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:32.928175 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d1e5d66f-e66d-4b39-b985-9160506f7d53 req-ce3156d6-1e81-46e2-9c1a-be920d3996af tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0842690
May 20 16:22:32.975102 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d1e5d66f-e66d-4b39-b985-9160506f7d53 req-45b66d31-582e-4d46-9ceb-69cb8b1ab3c7 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410960
May 20 16:22:33.566726 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-658e79e2-d531-4f74-97ec-1d6e777c3b50 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:33.567425 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-658e79e2-d531-4f74-97ec-1d6e777c3b50 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Synchronizing usage tracker for tenant:04ea77fcf30a4817bec5800ecff20065 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:22:33.673934 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-658e79e2-d531-4f74-97ec-1d6e777c3b50 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Unset dirty status for tenant:04ea77fcf30a4817bec5800ecff20065 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:22:33.675117 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-658e79e2-d531-4f74-97ec-1d6e777c3b50 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.16 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.1868834
May 20 16:22:33.804146 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e7c018-550d-440b-a7dc-12d0b6dcb956 req-31b9c128-7078-48c5-9110-d3b6f0f38242 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:33.805647 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07e7c018-550d-440b-a7dc-12d0b6dcb956 req-31b9c128-7078-48c5-9110-d3b6f0f38242 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0874708
May 20 16:22:33.825978 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Deleting port 2c8d7819-4077-463a-a3bc-0dcb0497beeb {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:22:33.826642 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:33.855411 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07e7c018-550d-440b-a7dc-12d0b6dcb956 req-5c265d50-98c7-43c9-898e-ee700b7d0663 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0440066
May 20 16:22:33.945506 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-321f8741-d724-4262-8b09-2c464e4eee64 req-c753aa12-1228-4755-8b35-f801f19eff7a tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] 10.222.0.64 "GET /v2.0/ports?device_id=94758bc3-9989-4360-b228-8f3243a7f897 HTTP/1.1" status: 200  len: 210 time: 0.0426784
May 20 16:22:33.965346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] For port 2c8d7819-4077-463a-a3bc-0dcb0497beeb, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=2c8d7819-4077-463a-a3bc-0dcb0497beeb,segment=NetworkSegment(b6d80164-e565-4ad3-a39d-687326b982c6),segment_id=b6d80164-e565-4ad3-a39d-687326b982c6)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:33.965698 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:34.094099 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Calling delete_port for 2c8d7819-4077-463a-a3bc-0dcb0497beeb owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:22:34.171171 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2982c7-0637-47c1-a003-55555626ca76 req-ba2a8cab-8bcf-4443-b6ca-82bc1b88192b tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:34.172785 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2c2982c7-0637-47c1-a003-55555626ca76 req-ba2a8cab-8bcf-4443-b6ca-82bc1b88192b tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 949 time: 0.0858755
May 20 16:22:34.226543 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2c2982c7-0637-47c1-a003-55555626ca76 req-185602de-2b6c-4165-9126-4427c572283e tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/security-groups?id=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470743
May 20 16:22:34.319382 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:34.325213 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5b6de954-51cb-494d-aad3-09154866ec9b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:34.331143 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['2c8d7819-4077-463a-a3bc-0dcb0497beeb'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:22:34.373014 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Pushing event deleted for resources: {'Port': ['ID=2c8d7819-4077-463a-a3bc-0dcb0497beeb,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:34.374577 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:34.450749 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] No DVR routers for this DVR port 2c8d7819-4077-463a-a3bc-0dcb0497beeb on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:22:34.453357 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:34.456011 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'name': 'network-vif-deleted', 'tag': '2c8d7819-4077-463a-a3bc-0dcb0497beeb'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:22:34.503456 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3b6c86f6-69c6-4deb-b5f5-67af110e4676', 'name': 'network-vif-deleted', 'tag': '2c8d7819-4077-463a-a3bc-0dcb0497beeb', 'status': 'completed', 'code': 200}
May 20 16:22:34.565753 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-f5a32beb-e438-4ab2-88f3-59826aba52af req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.16 "DELETE /v2.0/ports/2c8d7819-4077-463a-a3bc-0dcb0497beeb HTTP/1.1" status: 204  len: 173 time: 0.8842366
May 20 16:22:35.050579 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555abb8a-fa33-466c-a9cf-7ef46ba50073 req-a52cb3a9-5d18-4be4-a974-abf713ca03b0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:35.053130 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-555abb8a-fa33-466c-a9cf-7ef46ba50073 req-a52cb3a9-5d18-4be4-a974-abf713ca03b0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0838947
May 20 16:22:35.104068 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-555abb8a-fa33-466c-a9cf-7ef46ba50073 req-4c5aa4ec-9087-4c35-8ccc-86cc627d9645 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0440903
May 20 16:22:35.393364 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-231e540b-9309-4920-98b3-216187424f00 req-2c4bbe57-d8c0-4582-b219-57e0b0deb047 tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] 10.222.0.64 "GET /v2.0/ports?device_id=3b6c86f6-69c6-4deb-b5f5-67af110e4676 HTTP/1.1" status: 200  len: 210 time: 0.0449800
May 20 16:22:36.300485 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51bfa598-78c8-4e70-8f8c-ffbb71d86c45 req-c58d0428-5348-4071-bc9f-f45628081125 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:36.304993 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-51bfa598-78c8-4e70-8f8c-ffbb71d86c45 req-c58d0428-5348-4071-bc9f-f45628081125 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0829227
May 20 16:22:36.352443 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-51bfa598-78c8-4e70-8f8c-ffbb71d86c45 req-2a6218f4-de9a-42cf-874c-4452f6a2579a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0444863
May 20 16:22:37.331992 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 2c8d7819-4077-463a-a3bc-0dcb0497beeb no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:22:37.365862 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 2c8d7819-4077-463a-a3bc-0dcb0497beeb {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:22:37.366201 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 2c8d7819-4077-463a-a3bc-0dcb0497beeb not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:22:37.546205 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61bb3325-4e51-43ab-a892-efb119e605bc req-3482d1dc-b729-4b7a-928b-3640c47f6470 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:37.547782 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-61bb3325-4e51-43ab-a892-efb119e605bc req-3482d1dc-b729-4b7a-928b-3640c47f6470 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0838964
May 20 16:22:37.595928 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-61bb3325-4e51-43ab-a892-efb119e605bc req-77d634f0-73f6-4b9a-9f68-8b0a22fe025a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415940
May 20 16:22:38.831806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af06e26-87f9-4684-86ef-1f3cbf92e9ee req-ec26d3a4-16b2-480b-8af3-5e353e0ead30 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:38.833541 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0af06e26-87f9-4684-86ef-1f3cbf92e9ee req-ec26d3a4-16b2-480b-8af3-5e353e0ead30 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.1036220
May 20 16:22:38.883721 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0af06e26-87f9-4684-86ef-1f3cbf92e9ee req-4b73648d-37c8-4655-bc2b-546fb19ccd55 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412183
May 20 16:22:40.079440 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837d78ad-cc9f-4f07-82ff-75e97feeda90 req-7ddf5567-8e0c-4361-b8ce-c63eb0b3d9b5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:40.080904 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-837d78ad-cc9f-4f07-82ff-75e97feeda90 req-7ddf5567-8e0c-4361-b8ce-c63eb0b3d9b5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0800297
May 20 16:22:40.126285 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-837d78ad-cc9f-4f07-82ff-75e97feeda90 req-12960167-5ce2-4f19-b836-5825c5d5a7af tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388937
May 20 16:22:41.328118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c3c519-46b8-479f-8218-38058fe06b82 req-54b29e94-7625-4dda-9ca4-dce100663ce8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:41.329624 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-35c3c519-46b8-479f-8218-38058fe06b82 req-54b29e94-7625-4dda-9ca4-dce100663ce8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0867696
May 20 16:22:41.377288 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-35c3c519-46b8-479f-8218-38058fe06b82 req-414410b6-ad69-4d3d-8193-7050941d6c4c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413792
May 20 16:22:42.573523 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3def3563-a831-4677-896b-35e0aebf21b1 req-c6963bac-dcb2-4591-9c6a-383a19bd8a99 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:42.575007 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3def3563-a831-4677-896b-35e0aebf21b1 req-c6963bac-dcb2-4591-9c6a-383a19bd8a99 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0829182
May 20 16:22:42.625689 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3def3563-a831-4677-896b-35e0aebf21b1 req-a98665d1-db3a-4f48-83b4-067072b04bae tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0439503
May 20 16:22:43.818186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899a920d-fd6f-4f63-a232-95f42666991f req-b12e2f79-2f33-450b-b93d-887bc02c764d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:43.819723 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-899a920d-fd6f-4f63-a232-95f42666991f req-b12e2f79-2f33-450b-b93d-887bc02c764d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0831563
May 20 16:22:43.866142 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-899a920d-fd6f-4f63-a232-95f42666991f req-36a7efb9-fdaf-4ac2-a3b0-a4f96625c184 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403504
May 20 16:22:45.065235 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c8546c-65bb-4b0f-9418-b8668e4a6378 req-ea778701-8d7d-412b-be93-90df6be58e77 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:45.066719 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e8c8546c-65bb-4b0f-9418-b8668e4a6378 req-ea778701-8d7d-412b-be93-90df6be58e77 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 943 time: 0.0887775
May 20 16:22:45.112822 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e8c8546c-65bb-4b0f-9418-b8668e4a6378 req-59c0c80f-fed0-449d-9367-ae82eb20e4ab tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400939
May 20 16:22:45.241386 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36412) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:45.393920 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-54d3920f-ac3e-4a1c-a993-d3cbdfb50872 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=04ea77fcf30a4817bec5800ecff20065&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1512938
May 20 16:22:45.396861 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36420) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:45.401422 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:22:45.460601 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:45.488198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:45.552139 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:45.555730 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'port_id': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'mac_address': 'fa:16:3e:eb:92:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:22:45.605147 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:45.609900 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4ce5728c-a487-4788-8d87-880e684a2ab4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:45.610245 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:45.624508 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:45.626365 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:45.627164 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c1d2c1d-f53f-4921-822b-db24d856090e {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:22:45.630325 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/ca4ad17a-da1d-4ef4-a83e-63c9ad9014bf HTTP/1.1" status: 204  len: 168 time: 0.2325268
May 20 16:22:45.631304 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:45.654429 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:45.731144 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:45.732949 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-1baed4fb-18ee-4ae8-98c2-06f7ca5db9a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:45.809726 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=9']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:45.819351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.819689 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.820014 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.820334 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.820645 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.820957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.821268 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.821583 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.821892 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.822200 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.822503 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.822805 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:45.826696 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:45.908318 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c11455f7-affc-4744-b1e8-4bd7c878d93b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:46.143432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['4c1d2c1d-f53f-4921-822b-db24d856090e'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:22:46.336017 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f211b3-6b80-4a4d-8cb0-49e8e3e1763c req-0c827909-0c8f-4f39-8c04-cdb1f811e02e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:46.339671 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a3f211b3-6b80-4a4d-8cb0-49e8e3e1763c req-0c827909-0c8f-4f39-8c04-cdb1f811e02e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 944 time: 0.0992892
May 20 16:22:46.386874 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a3f211b3-6b80-4a4d-8cb0-49e8e3e1763c req-5c499971-05ea-4b77-8884-f9f1b88a4558 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428436
May 20 16:22:46.769985 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36458) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:46.878901 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2033331546-network', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:22:46.883672 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:46.887703 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Usage tracker for resource:network and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:46.890746 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:46.897880 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:47.022237 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Made reservation on behalf of 8614158322ae423bb16b1c0645c66cf9 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:22:47.024520 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.040499 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.054278 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:47.058161 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:47.061002 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:47.066653 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:47.148235 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.251008 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.254106 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-970bb9d4-af9b-4728-bee8-3247d7046fd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:47.282944 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] vlan segment allocate from pool success with {'vlan_id': 644, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:22:47.291383 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62841583-ef69-4bd6-9ba1-a6118731c4d9,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:47.294517 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:47.302298 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.302298 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Added segment 6dfff34b-4d7f-4dbe-be5c-23338c108e5f of type vlan for network 1c714e06-ccca-4a05-8bd6-477318017820
May 20 16:22:47.324282 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.422960 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:22:47.428101 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.429542 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:47.430244 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.440302 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ced31e82-4f7e-4d17-b94e-a0b4a39061f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:47.496361 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 4c1d2c1d-f53f-4921-822b-db24d856090e triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:47.496733 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.546218 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Pushing event updated for resources: {'Network': ['ID=1c714e06-ccca-4a05-8bd6-477318017820,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:47.549387 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:47.557087 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 1c714e06-ccca-4a05-8bd6-477318017820 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:22:47.560218 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.7888818
May 20 16:22:47.562931 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36468) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:47.586907 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Request body: {'subnet': {'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2033331546-subnet', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:22:47.599321 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:47.613632 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Usage tracker for resource:subnet and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:47.623892 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:47.633327 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:47.705434 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbcb4768-92c2-4f5d-a56a-53e2d9eb380e req-3c43dfbb-7977-4d09-ac50-5ac667c19a45 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:47.707751 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fbcb4768-92c2-4f5d-a56a-53e2d9eb380e req-3c43dfbb-7977-4d09-ac50-5ac667c19a45 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 944 time: 0.2009413
May 20 16:22:47.731153 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.748413 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Made reservation on behalf of 8614158322ae423bb16b1c0645c66cf9 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:22:47.750835 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6223402'] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.772826 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:22:47.773189 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fbcb4768-92c2-4f5d-a56a-53e2d9eb380e req-a7758867-e6f1-4e85-9dd7-259285336d31 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0585999
May 20 16:22:47.786963 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:47.857379 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:47.863046 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:47.965808 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=10']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:47.969277 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:48.006637 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'code': 200}
May 20 16:22:48.374797 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6358878', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6223416'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:48.379230 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:48.445381 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:48.450334 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Pushing event updated for resources: {'Subnet': ['ID=227d5494-8b2f-4a70-9e77-58d4d0e45746,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:48.454370 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:48.460071 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Checking segment: {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:22:48.460071 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Network hostable DHCP agents. Network: 1c714e06-ccca-4a05-8bd6-477318017820, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:22:48.558977 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Network 1c714e06-ccca-4a05-8bd6-477318017820 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:22:48.651151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-785b031d-db5c-4f96-8794-739b3ba4eb29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:48.690527 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 1c714e06-ccca-4a05-8bd6-477318017820) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:48.700324 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:48.700992 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:48.709835 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff5a8f50-fb1f-41ec-9906-b4a0cd631e8e None None] Network 1c714e06-ccca-4a05-8bd6-477318017820 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:22:48.843706 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2b9b6893-35b3-4603-8019-64e7d87ebc72 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.2793443
May 20 16:22:48.846394 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36488) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:48.852022 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:22:48.858883 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:48.867073 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Usage tracker for resource:router and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:48.876078 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:48.893925 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:48.923899 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d6d009-e213-4793-9d93-70ae30aa341e req-fa338e8e-e2a9-4a3b-989f-779ed1adc35c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:48.925533 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-03d6d009-e213-4793-9d93-70ae30aa341e req-fa338e8e-e2a9-4a3b-989f-779ed1adc35c service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1099 time: 0.1619487
May 20 16:22:48.948200 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-1c714e06-ccca-4a05-8bd6-477318017820', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:22:48.949091 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:48.983603 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-03d6d009-e213-4793-9d93-70ae30aa341e req-2bc5c958-213b-4053-8e9f-e9c97d1496e0 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0515351
May 20 16:22:49.026926 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.028173 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.052435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.069431 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60afe095-a507-48ec-92bd-378b0a654fe0 req-e03fa0c0-5ae3-49cc-9024-3f894102efa9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:49.070923 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60afe095-a507-48ec-92bd-378b0a654fe0 req-e03fa0c0-5ae3-49cc-9024-3f894102efa9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1202481
May 20 16:22:49.110315 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Allocated IP 172.20.0.2 (1c714e06-ccca-4a05-8bd6-477318017820/227d5494-8b2f-4a70-9e77-58d4d0e45746/4743695f-0807-4c8d-b272-ace68b5f4b7b) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:22:49.118408 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60afe095-a507-48ec-92bd-378b0a654fe0 req-7852d763-f02b-40f7-963a-76234c5e1586 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406928
May 20 16:22:49.324922 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.334926 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Transition to ACTIVE for port object 4743695f-0807-4c8d-b272-ace68b5f4b7b will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:22:49.353616 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Transition to ACTIVE for port object 4743695f-0807-4c8d-b272-ace68b5f4b7b will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:22:49.408509 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.462911 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.474016 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:49.562823 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Network 1c714e06-ccca-4a05-8bd6-477318017820 is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:22:49.569326 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:49.576424 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:22:49.582972 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Pushing event updated for resources: {'Port': ['ID=4743695f-0807-4c8d-b272-ace68b5f4b7b,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:49.586697 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:49.671447 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Attempting to bind port 4743695f-0807-4c8d-b272-ace68b5f4b7b on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:22:49.671825 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Attempting to bind port 4743695f-0807-4c8d-b272-ace68b5f4b7b by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:22:49.672217 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Attempting to bind port 4743695f-0807-4c8d-b272-ace68b5f4b7b on network 1c714e06-ccca-4a05-8bd6-477318017820 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:22:49.678103 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 22, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:22:49.678481 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Checking segment: {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:22:49.678887 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.679315 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Bound using segment: {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:22:49.679804 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Bound port: 4743695f-0807-4c8d-b272-ace68b5f4b7b, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:22:49.680164 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.744580 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.779711 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] For port 4743695f-0807-4c8d-b272-ace68b5f4b7b, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:22:49.782996 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] For port 4743695f-0807-4c8d-b272-ace68b5f4b7b, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=4743695f-0807-4c8d-b272-ace68b5f4b7b,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:22:49.896787 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.901604 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-68905a08-366c-4a66-9220-dbb78e50e98b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:49.924264 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.959102 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:49.978075 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Pushing event updated for resources: {'Port': ['ID=4743695f-0807-4c8d-b272-ace68b5f4b7b,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:49.981099 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:50.102226 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Allocated IP 172.27.0.56 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/20adbbc8-301e-4055-8fdb-062dcd9e25f4) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:22:50.334450 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:50.387395 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9bdd7a-9d43-4ecb-8e0b-3d14e258fe4b req-0d302db9-04c9-46a0-8806-cc45e1f89803 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:50.388886 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f9bdd7a-9d43-4ecb-8e0b-3d14e258fe4b req-0d302db9-04c9-46a0-8806-cc45e1f89803 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1260760
May 20 16:22:50.435539 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f9bdd7a-9d43-4ecb-8e0b-3d14e258fe4b req-0c5bb907-6591-4e5a-ab4f-9d1a61a0283f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399029
May 20 16:22:50.479677 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:50.483989 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:50.553617 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:22:50.556601 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:50.560889 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:22:50.594071 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Pushing event updated for resources: {'Port': ['ID=20adbbc8-301e-4055-8fdb-062dcd9e25f4,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:50.606824 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:51.024633 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5579e6c4-79b6-4e0d-9534-a8de4cf3881c None None] Network 1c714e06-ccca-4a05-8bd6-477318017820 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:22:51.308783 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-071629d1-6976-46fc-b225-a34978b5aafa None None] Provisioning for port 4743695f-0807-4c8d-b272-ace68b5f4b7b completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:22:51.324601 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:51.342449 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:51.599914 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 4743695f-0807-4c8d-b272-ace68b5f4b7b up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:22:51.766727 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:51.776675 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 4743695f-0807-4c8d-b272-ace68b5f4b7b completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:22:51.779166 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687440d2-67e2-45ea-af85-dccebddc7224 req-6162cfbb-8482-45dd-b6ba-d1a5d5ce340a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:51.780669 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-687440d2-67e2-45ea-af85-dccebddc7224 req-6162cfbb-8482-45dd-b6ba-d1a5d5ce340a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1873155
May 20 16:22:51.782047 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 4743695f-0807-4c8d-b272-ace68b5f4b7b triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:51.782580 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:51.908330 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:51.952774 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-687440d2-67e2-45ea-af85-dccebddc7224 req-14d4135b-713a-4fb0-98cf-4e36bf2e4fc1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1214936
May 20 16:22:51.956154 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 4743695f-0807-4c8d-b272-ace68b5f4b7b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=4743695f-0807-4c8d-b272-ace68b5f4b7b,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:52.040817 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:52.042703 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:52.068148 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Router 611172fd-bcae-4d71-9f24-054476247eea is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92421) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:22:52.108305 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=4743695f-0807-4c8d-b272-ace68b5f4b7b,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:52.111647 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:52.257715 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:22:52.266717 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Sync routers for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:22:52.280432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:22:52.288284 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711fed1c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:52.370265 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:52.371702 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.5242889
May 20 16:22:52.374384 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36548) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:52.459441 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:22:52.747306 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711fed1c0>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:50Z', 'revision_number': 3, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:50Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:52.751257 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Checking router: 611172fd-bcae-4d71-9f24-054476247eea for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:22:52.751614 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Updating router 611172fd-bcae-4d71-9f24-054476247eea port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:22:52.807413 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.160174 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.172148 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Transition to ACTIVE for port object 20adbbc8-301e-4055-8fdb-062dcd9e25f4 will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:22:53.226322 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.245639 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1925115a-269a-4591-8706-1fa2626f1841 req-8478132e-bfd1-44d6-bb72-48df6a2355ef tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:53.247134 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1925115a-269a-4591-8706-1fa2626f1841 req-8478132e-bfd1-44d6-bb72-48df6a2355ef tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1633413
May 20 16:22:53.251283 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.256191 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:53.328873 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Attempting to bind port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:22:53.330703 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Attempting to bind port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:22:53.330703 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Attempting to bind port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:22:53.335963 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b9b3143-d057-4ac8-8746-ec26734ff8a8 None None] Pushing event updated for resources: {'Port': ['ID=20adbbc8-301e-4055-8fdb-062dcd9e25f4,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:53.340030 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-3b9b3143-d057-4ac8-8746-ec26734ff8a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:53.343263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 22, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:22:53.343263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:22:53.343263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.343263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:22:53.343263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Bound port: 20adbbc8-301e-4055-8fdb-062dcd9e25f4, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:22:53.343263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.359746 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1925115a-269a-4591-8706-1fa2626f1841 req-cd043986-c884-40d3-8aa3-588087e458bc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1051598
May 20 16:22:53.425213 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] For port 20adbbc8-301e-4055-8fdb-062dcd9e25f4, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:22:53.428373 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] For port 20adbbc8-301e-4055-8fdb-062dcd9e25f4, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=20adbbc8-301e-4055-8fdb-062dcd9e25f4,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:22:53.484013 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Allocated IP 172.20.0.1 (1c714e06-ccca-4a05-8bd6-477318017820/227d5494-8b2f-4a70-9e77-58d4d0e45746/5eb209a1-6f70-43b5-b05d-364af120a723) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:22:53.503868 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.513272 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:53.550978 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 4743695f-0807-4c8d-b272-ace68b5f4b7b up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:22:53.639036 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:22:53.639682 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711fed1c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:53.640775 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.656654 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Transition to ACTIVE for port object 5eb209a1-6f70-43b5-b05d-364af120a723 will not be triggered until provisioned by entity DHCP. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:22:53.692543 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b9b3143-d057-4ac8-8746-ec26734ff8a8 None None] Pushing event updated for resources: {'Port': ['ID=20adbbc8-301e-4055-8fdb-062dcd9e25f4,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:53.706003 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-3b9b3143-d057-4ac8-8746-ec26734ff8a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:53.719911 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.725922 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c8a4ad90-3807-4968-8c35-3a6ed995f97d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:53.791871 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Network 1c714e06-ccca-4a05-8bd6-477318017820 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:22:53.794640 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:53.798173 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:22:53.800325 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 4743695f-0807-4c8d-b272-ace68b5f4b7b triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:53.800701 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.828454 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Pushing event updated for resources: {'Port': ['ID=5eb209a1-6f70-43b5-b05d-364af120a723,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:53.836859 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:53.860639 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:53.881463 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:22:54.063660 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:54.126384 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-b8b1dc85-1cc9-42ae-9ba2-97a09f326fa3 None None] Provisioning for port 5eb209a1-6f70-43b5-b05d-364af120a723 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:22:54.146136 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-b8b1dc85-1cc9-42ae-9ba2-97a09f326fa3 None None] Provisioning complete for port 5eb209a1-6f70-43b5-b05d-364af120a723 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:54.146521 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b8b1dc85-1cc9-42ae-9ba2-97a09f326fa3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:54.223528 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-b8b1dc85-1cc9-42ae-9ba2-97a09f326fa3 None None] Port 5eb209a1-6f70-43b5-b05d-364af120a723 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:22:54.285811 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:54.286369 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711fed1c0>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:50Z', 'revision_number': 3, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:54.290324 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cff3aabb-3440-4d8a-ab3f-7299a1c0072e None None] The sync data for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi is: [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:50Z', 'revision_number': 3, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:22:54.347471 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:54.478061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-fa7311cc-4c93-403c-88ad-9e1f1f43a93b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:54.614710 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Pushing event updated for resources: {'Port': ['ID=5eb209a1-6f70-43b5-b05d-364af120a723,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:54.633544 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.633915 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.634277 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.634632 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.634988 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.635363 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.635711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.636055 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.636402 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.636744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.637084 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.637420 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:54.640820 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:54.644727 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:54.754349 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2236715-f098-45f8-9753-14dbf1c7c7ae req-80cb5ce2-6d83-45fd-b4f4-c2a1928a70ce tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:54.756516 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c2236715-f098-45f8-9753-14dbf1c7c7ae req-80cb5ce2-6d83-45fd-b4f4-c2a1928a70ce tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.2296653
May 20 16:22:54.827157 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c2236715-f098-45f8-9753-14dbf1c7c7ae req-618bd8ea-75e9-4565-9275-d46e13039f64 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0625391
May 20 16:22:54.836604 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Network 1c714e06-ccca-4a05-8bd6-477318017820 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:22:54.837917 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:55.040315 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Router 611172fd-bcae-4d71-9f24-054476247eea has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:22:55.046270 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-91b3d99c-d09a-4c1d-baa4-5b82836ac754 None None] Provisioning complete for port 5eb209a1-6f70-43b5-b05d-364af120a723 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:55.046648 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-91b3d99c-d09a-4c1d-baa4-5b82836ac754 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:55.108005 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-91b3d99c-d09a-4c1d-baa4-5b82836ac754 None None] Port 5eb209a1-6f70-43b5-b05d-364af120a723 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:22:55.220486 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:22:55.230010 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] 10.222.0.64 "PUT /v2.0/routers/611172fd-bcae-4d71-9f24-054476247eea/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8545606
May 20 16:22:55.563566 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 20adbbc8-301e-4055-8fdb-062dcd9e25f4 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:22:55.702374 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:22:55.707423 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:55.708359 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:55.833270 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:55.851661 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 20adbbc8-301e-4055-8fdb-062dcd9e25f4, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=20adbbc8-301e-4055-8fdb-062dcd9e25f4,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:55.852565 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Sync routers for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:22:55.864363 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:22:55.867353 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712806340>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:55.947255 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:55.949118 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:56.044226 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:22:56.058541 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48cc908d-2765-469a-b1ac-dac8903fed00 req-fbcd378e-b78d-4f48-9dd0-cc2b6a621564 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:56.069624 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-48cc908d-2765-469a-b1ac-dac8903fed00 req-fbcd378e-b78d-4f48-9dd0-cc2b6a621564 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1122744
May 20 16:22:56.091321 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=20adbbc8-301e-4055-8fdb-062dcd9e25f4,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:56.091487 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36580) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:56.091487 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-109283087-network', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:22:56.095644 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:56.098102 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:56.100904 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Usage tracker for resource:network and tenant:47c8c71c28504a48b0c41b67cebe6af8 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:56.103865 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:56.111016 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:56.134613 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-48cc908d-2765-469a-b1ac-dac8903fed00 req-8e42fab2-ad57-49dc-8d7f-24660d76615c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0618145
May 20 16:22:56.188903 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Made reservation on behalf of 47c8c71c28504a48b0c41b67cebe6af8 for: {'network': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:22:56.191487 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.209168 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.227121 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:56.232904 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Usage tracker for resource:security_group_rule and tenant:47c8c71c28504a48b0c41b67cebe6af8 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:56.238632 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-0798a267-ec25-4906-aa06-0f326bf6f75f service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1155946
May 20 16:22:56.239430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:56.245486 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:56.371610 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712806340>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:54Z', 'revision_number': 2, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:56.375614 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Checking router: 611172fd-bcae-4d71-9f24-054476247eea for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:22:56.375964 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Updating router 611172fd-bcae-4d71-9f24-054476247eea port 5eb209a1-6f70-43b5-b05d-364af120a723 binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:22:56.388412 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.408648 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-da613c14-1a6b-4705-8512-5b6b3733992a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:56.410179 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-da613c14-1a6b-4705-8512-5b6b3733992a service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1098 time: 0.0857089
May 20 16:22:56.429095 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.513539 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.522594 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4f675276-c4a6-4a5a-b723-dbd6c4e4b5de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:56.546430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] vlan segment allocate from pool success with {'vlan_id': 603, 'physical_network': 'physnet1'}  {{(pid=92422) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:22:56.572942 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f56cdef3-5121-4f41-94c0-b67f71d82e31,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:56.578760 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.579152 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.segments_db [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Added segment 5d3b33a9-1085-4105-a5b2-b4ebe69df857 of type vlan for network c4ec3478-ddb6-4d18-a356-047ead7a15dd
May 20 16:22:56.581035 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:56.607947 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-696bbc97-8596-4c91-804b-eedd3fa249ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:56.609507 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-696bbc97-8596-4c91-804b-eedd3fa249ee service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.1813729
May 20 16:22:56.679408 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.741406 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-16e6de32-f485-4d1f-9c62-2ad6562a7e08 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 1001 time: 0.1228850
May 20 16:22:56.778448 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.789534 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Transition to ACTIVE for port object 5eb209a1-6f70-43b5-b05d-364af120a723 will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:22:56.806838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.809649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:56.810218 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.815285 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:56.831852 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-4c8d3746-fc04-4dde-a95e-b51c61c32cf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:56.833283 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-4c8d3746-fc04-4dde-a95e-b51c61c32cf8 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.0832570
May 20 16:22:56.902518 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:56.908098 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-9a50efc5-b5bb-49bb-81b8-7bf71d1637c8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:56.958923 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Pushing event updated for resources: {'Network': ['ID=c4ec3478-ddb6-4d18-a356-047ead7a15dd,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:56.968044 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:56.970408 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:22:56.988697 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-8f080298-f6bd-4134-a4d5-42fa4efacb21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:56.990692 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-8f080298-f6bd-4134-a4d5-42fa4efacb21 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1475887
May 20 16:22:57.032439 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Pushing event updated for resources: {'Port': ['ID=5eb209a1-6f70-43b5-b05d-364af120a723,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:57.048243 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.048825 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.049371 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.049907 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.050401 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.050878 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.052098 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.052599 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.053094 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.053588 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.054060 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.054523 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92424) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:22:57.066068 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:57.122067 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.0380023
May 20 16:22:57.124970 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36588) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:57.135263 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Request body: {'subnet': {'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-109283087-subnet', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'ip_version': 4}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:22:57.140721 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:57.145284 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Usage tracker for resource:subnet and tenant:47c8c71c28504a48b0c41b67cebe6af8 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:57.153032 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:57.161284 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:57.171658 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-b2842bf7-6b99-472a-b079-1129a4a1ef41 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1737430
May 20 16:22:57.173906 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Attempting to bind port 5eb209a1-6f70-43b5-b05d-364af120a723 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:22:57.177794 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Attempting to bind port 5eb209a1-6f70-43b5-b05d-364af120a723 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:22:57.177794 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Attempting to bind port 5eb209a1-6f70-43b5-b05d-364af120a723 on network 1c714e06-ccca-4a05-8bd6-477318017820 {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:22:57.186154 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 22, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:22:57.186629 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Checking segment: {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:22:57.187090 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:57.187605 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Bound using segment: {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:22:57.188114 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Bound port: 5eb209a1-6f70-43b5-b05d-364af120a723, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:22:57.188554 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:57.245317 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Made reservation on behalf of 47c8c71c28504a48b0c41b67cebe6af8 for: {'subnet': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:22:57.252282 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6029181'] for subnet, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:57.298178 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] For port 5eb209a1-6f70-43b5-b05d-364af120a723, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:22:57.301669 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] For port 5eb209a1-6f70-43b5-b05d-364af120a723, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=5eb209a1-6f70-43b5-b05d-364af120a723,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:22:57.326653 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e17678ba-6f3c-4bb4-ae10-b0a46077584a req-0e71bf33-7ea9-456e-b6d4-ec36d159de6f service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1475024
May 20 16:22:57.366085 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:57.370261 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-524096e9-ef59-4cda-b617-86eb0c32e2ee None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:57.437570 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4af2ee9-6d51-4434-9b3b-32b6ac89d553 req-14a843e8-cc26-4985-9a96-e390670deb0f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:57.439030 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4af2ee9-6d51-4434-9b3b-32b6ac89d553 req-14a843e8-cc26-4985-9a96-e390670deb0f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1699722
May 20 16:22:57.481440 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:22:57.482087 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712806340>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:57.545488 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4af2ee9-6d51-4434-9b3b-32b6ac89d553 req-6e6c2ba9-9493-486b-8803-0488646746c2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0984709
May 20 16:22:57.562274 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Pushing event updated for resources: {'Port': ['ID=5eb209a1-6f70-43b5-b05d-364af120a723,revision_number=4']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:57.563341 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 20adbbc8-301e-4055-8fdb-062dcd9e25f4 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:22:57.573298 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-f55c79aa-cffd-42bb-8908-e6d41d3bc94a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:57.653910 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:57.654290 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:57.703781 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:22:57.885235 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6100820', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6029167'] for subnet, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:57.889819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:57.966025 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=abe3891f-50c2-4139-bde9-d3bda422e3a4,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:57.968846 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:57.973343 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Checking segment: {'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:22:57.973688 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Network hostable DHCP agents. Network: c4ec3478-ddb6-4d18-a356-047ead7a15dd, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92421) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:22:58.050156 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712806340>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:57Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:22:58.050734 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83a764a0-c077-419b-bf46-26f9ec8cc77c None None] The sync data for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi is: [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:57Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:22:58.068499 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92421) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:22:58.165252 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, c4ec3478-ddb6-4d18-a356-047ead7a15dd) {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:58.179611 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:22:58.179844 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15a375ff-d62b-4ffc-9ce9-91d834166d09 None None] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:22:58.180610 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.286310 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-7bcdd684-d3f6-4739-b033-7fc6459b31c8 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.1591790
May 20 16:22:58.288828 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36602) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:22:58.294458 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:22:58.301605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:22:58.305891 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Usage tracker for resource:router and tenant:47c8c71c28504a48b0c41b67cebe6af8 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:22:58.308985 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:22:58.315631 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:22:58.413800 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.413800 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.414248 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'fixed_ips': [{'subnet_id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:22:58.415091 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.428122 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.579074 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Allocated IP 172.20.0.2 (c4ec3478-ddb6-4d18-a356-047ead7a15dd/abe3891f-50c2-4139-bde9-d3bda422e3a4/a5e8541f-5629-495f-a654-b4eca6ceaafe) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:22:58.820722 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.831985 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Transition to ACTIVE for port object a5e8541f-5629-495f-a654-b4eca6ceaafe will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:22:58.852666 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Transition to ACTIVE for port object a5e8541f-5629-495f-a654-b4eca6ceaafe will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:22:58.921233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.943433 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:58.948328 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:59.013160 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:22:59.016138 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:59.019934 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:22:59.029132 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Pushing event updated for resources: {'Port': ['ID=a5e8541f-5629-495f-a654-b4eca6ceaafe,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:59.056026 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:59.120619 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Attempting to bind port a5e8541f-5629-495f-a654-b4eca6ceaafe on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:22:59.120993 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Attempting to bind port a5e8541f-5629-495f-a654-b4eca6ceaafe by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:22:59.121358 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Attempting to bind port a5e8541f-5629-495f-a654-b4eca6ceaafe on network c4ec3478-ddb6-4d18-a356-047ead7a15dd {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:22:59.127136 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 22, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:22:59.127550 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Checking segment: {'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:22:59.127955 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.128349 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Bound using segment: {'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:22:59.128815 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Bound port: a5e8541f-5629-495f-a654-b4eca6ceaafe, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:22:59.129187 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.219688 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] For port a5e8541f-5629-495f-a654-b4eca6ceaafe, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:22:59.226641 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] For port a5e8541f-5629-495f-a654-b4eca6ceaafe, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=a5e8541f-5629-495f-a654-b4eca6ceaafe,segment=NetworkSegment(5d3b33a9-1085-4105-a5b2-b4ebe69df857),segment_id=5d3b33a9-1085-4105-a5b2-b4ebe69df857)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:22:59.320936 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.350139 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.353244 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.358011 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:59.404432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.436869 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Pushing event updated for resources: {'Port': ['ID=a5e8541f-5629-495f-a654-b4eca6ceaafe,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:59.439983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:22:59.498948 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Allocated IP 172.27.0.159 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/abc33861-aeab-4464-8097-834d7603bc27) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:22:59.563313 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 5eb209a1-6f70-43b5-b05d-364af120a723 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:22:59.679523 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.747689 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 5eb209a1-6f70-43b5-b05d-364af120a723 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:22:59.754105 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 5eb209a1-6f70-43b5-b05d-364af120a723 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:22:59.754990 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.799890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.804958 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:22:59.864699 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:22:59.867699 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:22:59.871469 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:22:59.880619 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:22:59.910117 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Pushing event updated for resources: {'Port': ['ID=abc33861-aeab-4464-8097-834d7603bc27,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:22:59.916701 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 5eb209a1-6f70-43b5-b05d-364af120a723, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=5eb209a1-6f70-43b5-b05d-364af120a723,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:22:59.918399 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:00.016682 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:00.019662 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:00.089455 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=5eb209a1-6f70-43b5-b05d-364af120a723,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:00.092641 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:00.387144 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d654a6fc-d620-4264-a323-e4773a7166a8 None None] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:23:00.494531 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:00.572004 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-26250010-0122-4163-88a3-60d41f1dafcc None None] Provisioning for port a5e8541f-5629-495f-a654-b4eca6ceaafe completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:00.848701 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:01.153666 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Router c5f99b4f-9fe9-4916-a604-1236ccbcea58 is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92421) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:23:01.337955 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:23:01.346525 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Sync routers for ids ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:23:01.357073 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Routers {'c5f99b4f-9fe9-4916-a604-1236ccbcea58'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:01.357916 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71205cdf0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:01.449707 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:01.453585 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.1611817
May 20 16:23:01.453719 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36630) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:01.568129 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Set router c5f99b4f-9fe9-4916-a604-1236ccbcea58 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:01.680776 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 5eb209a1-6f70-43b5-b05d-364af120a723 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:01.856104 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 5eb209a1-6f70-43b5-b05d-364af120a723 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:01.856480 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.014805 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71205cdf0>, [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': 'abc33861-aeab-4464-8097-834d7603bc27', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:23:00Z', 'revision_number': 3, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port': {'id': 'abc33861-aeab-4464-8097-834d7603bc27', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:68:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:59Z', 'updated_at': '2021-05-20T16:22:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:02.024095 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Checking router: c5f99b4f-9fe9-4916-a604-1236ccbcea58 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:23:02.024436 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Updating router c5f99b4f-9fe9-4916-a604-1236ccbcea58 port abc33861-aeab-4464-8097-834d7603bc27 binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:23:02.053900 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device a5e8541f-5629-495f-a654-b4eca6ceaafe up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:02.122909 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.259343 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.297042 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port a5e8541f-5629-495f-a654-b4eca6ceaafe completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:02.305415 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port a5e8541f-5629-495f-a654-b4eca6ceaafe triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:02.305786 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.475492 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Allocated IP 172.20.0.1 (c4ec3478-ddb6-4d18-a356-047ead7a15dd/abe3891f-50c2-4139-bde9-d3bda422e3a4/c05947f6-99d2-4919-828b-fae8cd15a87b) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:02.545590 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.616613 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.625879 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port a5e8541f-5629-495f-a654-b4eca6ceaafe, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=a5e8541f-5629-495f-a654-b4eca6ceaafe,segment=NetworkSegment(5d3b33a9-1085-4105-a5b2-b4ebe69df857),segment_id=5d3b33a9-1085-4105-a5b2-b4ebe69df857)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:02.632501 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Transition to ACTIVE for port object abc33861-aeab-4464-8097-834d7603bc27 will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:02.653697 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.671622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Transition to ACTIVE for port object c05947f6-99d2-4919-828b-fae8cd15a87b will not be triggered until provisioned by entity DHCP. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:02.697382 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.698523 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6f7abf80-a8c0-4c6a-a68f-c7230921fa4b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:02.749955 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.776699 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.782105 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:02.782404 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=a5e8541f-5629-495f-a654-b4eca6ceaafe,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:02.786365 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:02.786831 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.031s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:02.819865 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Attempting to bind port abc33861-aeab-4464-8097-834d7603bc27 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:02.819865 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Attempting to bind port abc33861-aeab-4464-8097-834d7603bc27 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:02.820191 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Attempting to bind port abc33861-aeab-4464-8097-834d7603bc27 on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:02.842646 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:02.845833 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:02.849864 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:02.894531 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Pushing event updated for resources: {'Port': ['ID=c05947f6-99d2-4919-828b-fae8cd15a87b,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:02.900760 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25fd3e3-8772-4cd2-ae9d-8b408ca3d23d None None] Pushing event updated for resources: {'Port': ['ID=abc33861-aeab-4464-8097-834d7603bc27,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:02.902743 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:02.903876 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f25fd3e3-8772-4cd2-ae9d-8b408ca3d23d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:02.907262 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 22, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:02.907643 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:02.908052 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.908417 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:02.908884 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Bound port: abc33861-aeab-4464-8097-834d7603bc27, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:02.909263 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.928841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:02.987763 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] For port abc33861-aeab-4464-8097-834d7603bc27, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:02.992144 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] For port abc33861-aeab-4464-8097-834d7603bc27, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=abc33861-aeab-4464-8097-834d7603bc27,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:03.050926 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:03.055336 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:03.129255 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Routers {'c5f99b4f-9fe9-4916-a604-1236ccbcea58'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:03.130000 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71205cdf0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:03.135976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:03.208162 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25fd3e3-8772-4cd2-ae9d-8b408ca3d23d None None] Pushing event updated for resources: {'Port': ['ID=abc33861-aeab-4464-8097-834d7603bc27,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:03.222268 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f25fd3e3-8772-4cd2-ae9d-8b408ca3d23d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:03.310296 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-e191a10b-bf2e-4d50-a4b6-79fe91a77880 None None] Provisioning for port c05947f6-99d2-4919-828b-fae8cd15a87b completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:03.320150 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-e191a10b-bf2e-4d50-a4b6-79fe91a77880 None None] Provisioning complete for port c05947f6-99d2-4919-828b-fae8cd15a87b triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:03.320535 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-e191a10b-bf2e-4d50-a4b6-79fe91a77880 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:03.373774 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:03.375936 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] Set router c5f99b4f-9fe9-4916-a604-1236ccbcea58 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:03.445984 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-e191a10b-bf2e-4d50-a4b6-79fe91a77880 None None] Port c05947f6-99d2-4919-828b-fae8cd15a87b cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:23:03.468156 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:03.493916 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-edd90457-6a4f-4b66-b726-fc6f7113bd17 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:03.550968 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device a5e8541f-5629-495f-a654-b4eca6ceaafe up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:03.578704 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Pushing event updated for resources: {'Port': ['ID=c05947f6-99d2-4919-828b-fae8cd15a87b,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:03.581095 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:03.585551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:03.719314 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:03.720497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:03.733500 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port a5e8541f-5629-495f-a654-b4eca6ceaafe triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:03.733997 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:03.859872 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71205cdf0>, [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': 'abc33861-aeab-4464-8097-834d7603bc27', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:23:03Z', 'revision_number': 4, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port': {'id': 'abc33861-aeab-4464-8097-834d7603bc27', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:68:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:59Z', 'updated_at': '2021-05-20T16:23:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'c05947f6-99d2-4919-828b-fae8cd15a87b', 'name': '', 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'mac_address': 'fa:16:3e:3f:b5:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:02Z', 'updated_at': '2021-05-20T16:23:02Z', 'revision_number': 1, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'subnets': [{'id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:03.874722 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaf05da6-d79a-4fd6-bd20-8f8df93dfe44 None None] The sync data for ids ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'] in dv-cinder-689486-13-iscsi is: [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': 'abc33861-aeab-4464-8097-834d7603bc27', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:23:03Z', 'revision_number': 4, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port': {'id': 'abc33861-aeab-4464-8097-834d7603bc27', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:68:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:59Z', 'updated_at': '2021-05-20T16:23:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'c05947f6-99d2-4919-828b-fae8cd15a87b', 'name': '', 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'mac_address': 'fa:16:3e:3f:b5:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:02Z', 'updated_at': '2021-05-20T16:23:02Z', 'revision_number': 1, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'subnets': [{'id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:23:03.923000 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Router c5f99b4f-9fe9-4916-a604-1236ccbcea58 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:23:03.969139 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-8352ffbd-95e1-494a-9a35-217ec2fd8de5 None None] Provisioning complete for port c05947f6-99d2-4919-828b-fae8cd15a87b triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:03.969536 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8352ffbd-95e1-494a-9a35-217ec2fd8de5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:04.025546 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-8352ffbd-95e1-494a-9a35-217ec2fd8de5 None None] Port c05947f6-99d2-4919-828b-fae8cd15a87b cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:23:04.255054 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:23:04.263430 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] 10.222.0.64 "PUT /v2.0/routers/c5f99b4f-9fe9-4916-a604-1236ccbcea58/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8086791
May 20 16:23:04.966968 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:23:05.616120 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device abc33861-aeab-4464-8097-834d7603bc27 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:05.839410 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port abc33861-aeab-4464-8097-834d7603bc27 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:05.847550 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port abc33861-aeab-4464-8097-834d7603bc27 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:05.848330 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:06.004235 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:06.022834 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port abc33861-aeab-4464-8097-834d7603bc27, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=abc33861-aeab-4464-8097-834d7603bc27,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:06.158094 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Sync routers for ids ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:23:06.168421 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Routers {'c5f99b4f-9fe9-4916-a604-1236ccbcea58'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:06.169491 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712c7e700>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:06.207463 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:06.210989 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-3b9b3143-d057-4ac8-8746-ec26734ff8a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:06.319731 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=abc33861-aeab-4464-8097-834d7603bc27,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:06.323849 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:06.368033 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Set router c5f99b4f-9fe9-4916-a604-1236ccbcea58 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:06.711094 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712c7e700>, [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': 'abc33861-aeab-4464-8097-834d7603bc27', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:23:03Z', 'revision_number': 4, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port': {'id': 'abc33861-aeab-4464-8097-834d7603bc27', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:68:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:59Z', 'updated_at': '2021-05-20T16:23:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'c05947f6-99d2-4919-828b-fae8cd15a87b', 'name': '', 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'mac_address': 'fa:16:3e:3f:b5:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:02Z', 'updated_at': '2021-05-20T16:23:03Z', 'revision_number': 2, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'subnets': [{'id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:06.716365 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Checking router: c5f99b4f-9fe9-4916-a604-1236ccbcea58 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:23:06.716365 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Updating router c5f99b4f-9fe9-4916-a604-1236ccbcea58 port c05947f6-99d2-4919-828b-fae8cd15a87b binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:23:06.778025 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:07.287146 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:07.305450 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Transition to ACTIVE for port object c05947f6-99d2-4919-828b-fae8cd15a87b will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:07.387631 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:07.397982 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:07.489256 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0618178-a49d-4fce-8636-839881e2ce86 None None] Pushing event updated for resources: {'Port': ['ID=c05947f6-99d2-4919-828b-fae8cd15a87b,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:07.586208 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-d0618178-a49d-4fce-8636-839881e2ce86 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:07.614924 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device abc33861-aeab-4464-8097-834d7603bc27 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:07.727239 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Attempting to bind port c05947f6-99d2-4919-828b-fae8cd15a87b on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:07.727775 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Attempting to bind port c05947f6-99d2-4919-828b-fae8cd15a87b by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:07.728136 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Attempting to bind port c05947f6-99d2-4919-828b-fae8cd15a87b on network c4ec3478-ddb6-4d18-a356-047ead7a15dd {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:07.735543 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 22, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:07.735930 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Checking segment: {'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:07.736553 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:07.736948 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Bound using segment: {'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:07.737833 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Bound port: c05947f6-99d2-4919-828b-fae8cd15a87b, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d3b33a9-1085-4105-a5b2-b4ebe69df857', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:07.738378 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:07.739613 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port abc33861-aeab-4464-8097-834d7603bc27 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:07.755477 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:07.852659 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] For port c05947f6-99d2-4919-828b-fae8cd15a87b, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:07.861395 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] For port c05947f6-99d2-4919-828b-fae8cd15a87b, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=c05947f6-99d2-4919-828b-fae8cd15a87b,segment=NetworkSegment(5d3b33a9-1085-4105-a5b2-b4ebe69df857),segment_id=5d3b33a9-1085-4105-a5b2-b4ebe69df857)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:08.147515 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:08.151544 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-7d8f06e5-f8b2-421e-95fb-8caef1daff9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:08.228541 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Routers {'c5f99b4f-9fe9-4916-a604-1236ccbcea58'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:08.229178 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712c7e700>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:22:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:08.281058 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0618178-a49d-4fce-8636-839881e2ce86 None None] Pushing event updated for resources: {'Port': ['ID=c05947f6-99d2-4919-828b-fae8cd15a87b,revision_number=4']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:08.289146 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-d0618178-a49d-4fce-8636-839881e2ce86 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:08.421509 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] Set router c5f99b4f-9fe9-4916-a604-1236ccbcea58 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:08.773980 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712c7e700>, [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': 'abc33861-aeab-4464-8097-834d7603bc27', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:23:03Z', 'revision_number': 4, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port': {'id': 'abc33861-aeab-4464-8097-834d7603bc27', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:68:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:59Z', 'updated_at': '2021-05-20T16:23:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'c05947f6-99d2-4919-828b-fae8cd15a87b', 'name': '', 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'mac_address': 'fa:16:3e:3f:b5:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:02Z', 'updated_at': '2021-05-20T16:23:07Z', 'revision_number': 4, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'subnets': [{'id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:08.780265 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7abba840-196e-4dce-87d7-f4c1b9a29d72 None None] The sync data for ids ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'] in dv-cinder-689486-13-iscsi is: [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': 'abc33861-aeab-4464-8097-834d7603bc27', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:23:03Z', 'revision_number': 4, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port': {'id': 'abc33861-aeab-4464-8097-834d7603bc27', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:68:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:59Z', 'updated_at': '2021-05-20T16:23:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'c05947f6-99d2-4919-828b-fae8cd15a87b', 'name': '', 'network_id': 'c4ec3478-ddb6-4d18-a356-047ead7a15dd', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'mac_address': 'fa:16:3e:3f:b5:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:02Z', 'updated_at': '2021-05-20T16:23:07Z', 'revision_number': 4, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'subnets': [{'id': 'abe3891f-50c2-4139-bde9-d3bda422e3a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:23:09.600763 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device c05947f6-99d2-4919-828b-fae8cd15a87b up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:09.753290 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port c05947f6-99d2-4919-828b-fae8cd15a87b completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:09.759916 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port c05947f6-99d2-4919-828b-fae8cd15a87b triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:09.763478 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:09.958653 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:09.968698 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36726) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:10.010054 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port c05947f6-99d2-4919-828b-fae8cd15a87b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=c05947f6-99d2-4919-828b-fae8cd15a87b,segment=NetworkSegment(5d3b33a9-1085-4105-a5b2-b4ebe69df857),segment_id=5d3b33a9-1085-4105-a5b2-b4ebe69df857)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:10.033045 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Deleting subnet a138ecac-0095-4014-bd32-91dbb855f1d1 {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:23:10.037125 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.094858 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.130640 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.132618 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:10.169366 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.224169 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=c05947f6-99d2-4919-828b-fae8cd15a87b,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:10.227847 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:10.576537 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.581261 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:10.619634 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a138ecac-0095-4014-bd32-91dbb855f1d1,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:10.623648 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:10.632351 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.641078 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-bea09067-c0c7-4c21-8a69-1bbb417c1169 admin admin] 10.222.0.64 "DELETE /v2.0/subnets/a138ecac-0095-4014-bd32-91dbb855f1d1 HTTP/1.1" status: 204  len: 168 time: 0.6689639
May 20 16:23:10.641392 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36732) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:10.764114 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.904711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.920210 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe71262c490>,) {'filters': {'network_id': ['3b4ff6d7-4fdf-4a00-84ee-540ff69761ca']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:10.934929 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71262c490>, 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:10.935271 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71262c490>, 'd381c96c-d9a4-4090-b7b0-51fe6ac531dd') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:10.948101 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.966241 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.974656 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Releasing vlan 639 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:23:10.975318 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:23:10.990107 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:23:11.216556 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:11.245358 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-00849a11-14f5-47a3-917d-ca9d4cf9e1db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:11.260362 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:11.271645 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Pushing event deleted for resources: {'Network': ['ID=3b4ff6d7-4fdf-4a00-84ee-540ff69761ca,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:11.274935 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:11.690297 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device c05947f6-99d2-4919-828b-fae8cd15a87b up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:11.690297 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port c05947f6-99d2-4919-828b-fae8cd15a87b triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:11.690297 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:11.845911 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-f77b02ad-6994-4602-9217-5b7d04a26c88 admin admin] 10.222.0.64 "DELETE /v2.0/networks/3b4ff6d7-4fdf-4a00-84ee-540ff69761ca HTTP/1.1" status: 204  len: 168 time: 1.2034562
May 20 16:23:12.215744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36746) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:12.269205 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-03156d7f-e02c-4726-a95a-1058047afd1a admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=685f156c43064dcf8880e8af97070ea9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0522361
May 20 16:23:12.271713 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36750) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:12.337199 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:12.371280 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:12.507689 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:12.512269 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e95a5ae9-af1c-4afe-a38c-3c044fdc68ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:12.523930 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ea187d4-f820-42b0-b9c6-b541013c8cb4,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:12.529007 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:12.609658 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:12.614913 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/2ea187d4-f820-42b0-b9c6-b541013c8cb4 HTTP/1.1" status: 204  len: 168 time: 0.3404498
May 20 16:23:15.959081 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-e5e7f6c4-045e-4188-bbd1-517e4e3ccac3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:18.246941 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-023e0f92-7660-47c0-825d-48ffde66e642 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:18.248556 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-023e0f92-7660-47c0-825d-48ffde66e642 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 815 time: 0.1478925
May 20 16:23:18.263548 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-dd2be30a-06de-4657-bb6e-0b0213e7c402 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/quotas/8614158322ae423bb16b1c0645c66cf9 HTTP/1.1" status: 200  len: 375 time: 0.0095086
May 20 16:23:18.347073 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-c0722bfb-eb2f-4020-8685-56074f19dd44 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Synchronizing usage tracker for tenant:8614158322ae423bb16b1c0645c66cf9 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:23:18.461742 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-c0722bfb-eb2f-4020-8685-56074f19dd44 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Unset dirty status for tenant:8614158322ae423bb16b1c0645c66cf9 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:23:18.467804 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:18.468299 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-c0722bfb-eb2f-4020-8685-56074f19dd44 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1944141
May 20 16:23:18.649511 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-96bd4e51-f65b-455e-9113-0613a6e4b595 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:18.712290 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-d830f4aa-be98-4381-aeda-509af0e2ac2d service neutron] 10.222.0.64 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2334108
May 20 16:23:18.842068 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-53406f42-b86f-42ec-9c8e-6db781f8be3e service neutron] 10.222.0.64 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1239283
May 20 16:23:19.215481 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ebdd7dcf-76b0-498e-b7df-2248c8c89062 req-75d09c28-7021-4cdd-80a1-5c5cf84e52a8 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 210 time: 0.1425238
May 20 16:23:19.587632 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:20.363169 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4b34e87-06ad-4b43-bc31-21c6593efef4 req-01d81c91-ef66-4ae4-aa07-bf88c1013b8d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 210 time: 0.0426543
May 20 16:23:21.249549 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:21.512958 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9ba78de6-e0ee-42e9-8a6c-099813bf4a3d req-3c8cdbd8-0a9b-4559-a8e0-8921a5e48ce2 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 210 time: 0.0439363
May 20 16:23:22.679540 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e77e0b5f-3aa8-4473-9177-60cc2d8071b1 req-067dca30-07e4-4dd0-bb32-b60eccf1d968 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 210 time: 0.0469744
May 20 16:23:23.835164 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c7511c2c-66e0-4bf7-aa0a-2cc3d0b9934a req-959ebf1e-5bd1-47a2-abaa-d4995fd64405 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 210 time: 0.0444484
May 20 16:23:24.309429 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-05184893-f960-44e7-b3e8-ecfccfd5aecd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:24.310114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-05184893-f960-44e7-b3e8-ecfccfd5aecd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Synchronizing usage tracker for tenant:8614158322ae423bb16b1c0645c66cf9 on resource:network {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:23:24.434023 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-05184893-f960-44e7-b3e8-ecfccfd5aecd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Unset dirty status for tenant:8614158322ae423bb16b1c0645c66cf9 on resource:network {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:23:24.435810 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-05184893-f960-44e7-b3e8-ecfccfd5aecd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.16 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 815 time: 0.2749450
May 20 16:23:24.456132 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'port': {'device_id': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'admin_state_up': True, 'tenant_id': '8614158322ae423bb16b1c0645c66cf9'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:24.596852 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:24.607036 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:24.673597 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Made reservation on behalf of 8614158322ae423bb16b1c0645c66cf9 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:23:24.677718 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:24.912174 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Allocated IP 172.20.0.13 (1c714e06-ccca-4a05-8bd6-477318017820/227d5494-8b2f-4a70-9e77-58d4d0e45746/16ee028f-977c-4c03-a101-a688c6953d30) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:24.997967 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d8b2e7b9-104b-4793-a464-31e0f3528208 req-d0a19fcb-08be-4021-8dec-55892eefc1c6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 210 time: 0.0444839
May 20 16:23:25.130924 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:25.145803 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Transition to ACTIVE for port object 16ee028f-977c-4c03-a101-a688c6953d30 will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:25.285667 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:25.294622 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-80c01fe0-c5c1-4123-876c-7ec15ae60b2e tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:25.402397 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:25.410308 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Network 1c714e06-ccca-4a05-8bd6-477318017820 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:25.414951 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:25.418059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.418768 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.419343 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.419868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.420443 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.420969 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.422484 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.423034 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.423631 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.424326 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.424848 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.425371 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:25.437190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:25.520270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:25.537035 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:25.537962 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:25.641198 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1886647
May 20 16:23:25.753130 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-eacc0681-79a9-40e3-a2e1-c7b04fc25283 None None] Provisioning for port 16ee028f-977c-4c03-a101-a688c6953d30 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:25.758804 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-eacc0681-79a9-40e3-a2e1-c7b04fc25283 None None] Provisioning complete for port 16ee028f-977c-4c03-a101-a688c6953d30 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:25.759211 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-eacc0681-79a9-40e3-a2e1-c7b04fc25283 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:25.816227 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-eacc0681-79a9-40e3-a2e1-c7b04fc25283 None None] Port 16ee028f-977c-4c03-a101-a688c6953d30 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:23:26.197469 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60290d8f-ff36-403e-aedd-575a3f23a3c2 req-31a8c976-2dc5-403e-b9bb-cec55ae7226a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:26.199388 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60290d8f-ff36-403e-aedd-575a3f23a3c2 req-31a8c976-2dc5-403e-b9bb-cec55ae7226a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.0910146
May 20 16:23:26.263000 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-60290d8f-ff36-403e-aedd-575a3f23a3c2 req-70f3b41a-7f27-4f29-840a-c337ec675bd7 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0566216
May 20 16:23:27.013423 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36928) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:27.134325 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:27.150230 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:27.154345 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Usage tracker for resource:security_group_rule and tenant:84b3c475b6674635adeb53c694d46388 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:27.157363 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:27.163121 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:27.250888 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:27.342385 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:27.352438 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-263ee4b4-22bf-46f8-b216-057c896fb9ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:27.436602 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=84b3c475b6674635adeb53c694d46388&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4219120
May 20 16:23:27.439079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36936) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:27.443945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9bac2aca-2b32-4c6a-8948-5e99bf0be410,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:27.468958 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:27.521655 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:27.555839 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1966795-4f52-4160-a7bf-fbe1fb970f62 req-441df2ef-168a-465a-a327-0a618feee2f2 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:27.557332 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a1966795-4f52-4160-a7bf-fbe1fb970f62 req-441df2ef-168a-465a-a327-0a618feee2f2 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.1905212
May 20 16:23:27.562065 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:27.641267 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a1966795-4f52-4160-a7bf-fbe1fb970f62 req-f0e8440d-5d99-4467-80a0-03cd3cc11cde tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0715644
May 20 16:23:27.820727 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:27.824536 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-536b1858-d9f9-40ed-a23d-0daa3b23af90 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:27.843031 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9bac2aca-2b32-4c6a-8948-5e99bf0be410,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:27.846803 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:27.851220 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:27.851951 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/9bac2aca-2b32-4c6a-8948-5e99bf0be410 HTTP/1.1" status: 204  len: 168 time: 0.4119523
May 20 16:23:28.843050 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbdf4bc7-37f1-4c68-9e41-e355d67c8de1 req-5b964c7c-c7ed-439f-a524-0fb793338dc6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:28.846839 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fbdf4bc7-37f1-4c68-9e41-e355d67c8de1 req-5b964c7c-c7ed-439f-a524-0fb793338dc6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.0853252
May 20 16:23:28.906090 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fbdf4bc7-37f1-4c68-9e41-e355d67c8de1 req-8620ac0e-02e2-466d-8d35-4e67827b8006 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481339
May 20 16:23:29.024275 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 36964) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:29.138257 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1569236740-network', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:29.143170 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:29.148047 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Usage tracker for resource:network and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:29.156364 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:29.162081 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:29.302001 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Made reservation on behalf of a6bd88ff65e9420a8ccb36968532c4f6 for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:23:29.304682 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.317865 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.332573 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:29.337130 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:29.341058 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:29.345778 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:29.365183 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.433499 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.541665 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.544851 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-61474f22-40c5-4f82-a47d-3cf07754e537 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:29.574055 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] vlan segment allocate from pool success with {'vlan_id': 637, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:23:29.582841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f24406af-f97d-4ad2-9779-ec228d2091ac,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:29.585980 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:29.590030 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.590362 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Added segment fc044b53-c97e-4bc3-a994-fbd15cd4e0a2 of type vlan for network a02876f9-a796-4512-9044-eb08bb5d54c6
May 20 16:23:29.618396 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.707282 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.708670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:29.709242 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:29.712840 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-8db54bb1-9713-4511-8595-c2dd4723c2ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:29.824287 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.7986398
May 20 16:23:29.827513 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36970) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:29.828023 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Pushing event updated for resources: {'Network': ['ID=a02876f9-a796-4512-9044-eb08bb5d54c6,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:29.830544 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:29.833406 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Request body: {'subnet': {'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1569236740-subnet', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:29.837883 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network a02876f9-a796-4512-9044-eb08bb5d54c6 details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:23:29.850149 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:29.854674 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Usage tracker for resource:subnet and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:29.858196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:29.865416 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:29.947650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Made reservation on behalf of a6bd88ff65e9420a8ccb36968532c4f6 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:23:29.950130 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6223402'] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:30.114659 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d31d52-e2a6-4520-9ad9-b59526d52217 req-46b3c22b-8f5a-4398-aca9-5251a6b31fd1 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:30.116835 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-48d31d52-e2a6-4520-9ad9-b59526d52217 req-46b3c22b-8f5a-4398-aca9-5251a6b31fd1 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.0954692
May 20 16:23:30.168672 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-48d31d52-e2a6-4520-9ad9-b59526d52217 req-bc38a637-efb1-40da-8ff9-f3c8211dc853 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461259
May 20 16:23:30.447570 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6358878', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6223416'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:30.453490 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-177c19a4-a3bf-47ef-af33-18f260523e0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:30.527362 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cb578eb9-d6e8-4e33-8d08-43894fe771d7,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:30.530824 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:30.537315 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Checking segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:30.537678 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Network hostable DHCP agents. Network: a02876f9-a796-4512-9044-eb08bb5d54c6, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:23:30.706345 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Network a02876f9-a796-4512-9044-eb08bb5d54c6 is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:23:30.809954 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, a02876f9-a796-4512-9044-eb08bb5d54c6) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:30.819245 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2ab6de5-480f-4cb0-8655-4589610c2f61 None None] Network a02876f9-a796-4512-9044-eb08bb5d54c6 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:23:30.819719 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:30.820117 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:30.925654 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.0968139
May 20 16:23:30.928300 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36976) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:30.933439 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:30.938433 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:30.942832 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Usage tracker for resource:router and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:30.946171 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:30.974582 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:31.036282 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-a02876f9-a796-4512-9044-eb08bb5d54c6', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:23:31.037099 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.102237 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.103333 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.120932 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.210322 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Allocated IP 172.20.0.2 (a02876f9-a796-4512-9044-eb08bb5d54c6/cb578eb9-d6e8-4e33-8d08-43894fe771d7/f32cfc28-580f-41b9-bde1-3682c8975a1b) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:31.414159 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdc0cc6-b06d-4c78-893c-2de05db10014 req-69cd0bdf-44b3-4aee-b562-4aa489ca079b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:31.416778 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8cdc0cc6-b06d-4c78-893c-2de05db10014 req-69cd0bdf-44b3-4aee-b562-4aa489ca079b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.1079242
May 20 16:23:31.448624 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.460593 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Transition to ACTIVE for port object f32cfc28-580f-41b9-bde1-3682c8975a1b will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:31.477787 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8cdc0cc6-b06d-4c78-893c-2de05db10014 req-107e626e-f3de-4f4a-ad55-b03172feb4eb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0548081
May 20 16:23:31.497356 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Transition to ACTIVE for port object f32cfc28-580f-41b9-bde1-3682c8975a1b will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:31.578335 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.604895 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.608663 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:31.673397 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Network a02876f9-a796-4512-9044-eb08bb5d54c6 is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:31.676278 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:31.679882 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:31.685539 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Pushing event updated for resources: {'Port': ['ID=f32cfc28-580f-41b9-bde1-3682c8975a1b,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:31.689344 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:31.790241 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Attempting to bind port f32cfc28-580f-41b9-bde1-3682c8975a1b on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:31.790610 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Attempting to bind port f32cfc28-580f-41b9-bde1-3682c8975a1b by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:31.790971 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Attempting to bind port f32cfc28-580f-41b9-bde1-3682c8975a1b on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:31.796550 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:31.796919 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Checking segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:31.797370 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.797760 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Bound using segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:31.798218 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Bound port: f32cfc28-580f-41b9-bde1-3682c8975a1b, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:31.798586 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.885651 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] For port f32cfc28-580f-41b9-bde1-3682c8975a1b, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:31.889387 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] For port f32cfc28-580f-41b9-bde1-3682c8975a1b, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=f32cfc28-580f-41b9-bde1-3682c8975a1b,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:31.969824 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:31.973755 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:32.058458 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Pushing event updated for resources: {'Port': ['ID=f32cfc28-580f-41b9-bde1-3682c8975a1b,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:32.064864 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:32.103136 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:32.135894 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:32.309293 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Allocated IP 172.27.0.41 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/87b02c72-143f-485c-ad40-ea2a7cb6de7f) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:32.548250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:32.700416 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb830e8c-3b2e-4bcd-8446-d844b12bf56e req-dead86de-3b8a-4534-8c5f-b5b6c3166027 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:32.701903 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eb830e8c-3b2e-4bcd-8446-d844b12bf56e req-dead86de-3b8a-4534-8c5f-b5b6c3166027 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.0869315
May 20 16:23:32.750149 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eb830e8c-3b2e-4bcd-8446-d844b12bf56e req-736ab6f9-1dff-407d-b0ac-d694442b3b8f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414534
May 20 16:23:32.781155 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:32.785501 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:32.857633 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:32.860587 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:32.863127 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:32.904005 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Pushing event updated for resources: {'Port': ['ID=87b02c72-143f-485c-ad40-ea2a7cb6de7f,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:32.911689 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:33.060413 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a08f6ba-9e43-40e1-a0d3-009b62b435d7 None None] Network a02876f9-a796-4512-9044-eb08bb5d54c6 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:23:33.318839 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-49ece494-1a0a-4089-943d-1a931b35ac6f None None] Provisioning for port f32cfc28-580f-41b9-bde1-3682c8975a1b completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:33.405535 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:33.607213 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device f32cfc28-580f-41b9-bde1-3682c8975a1b up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:33.758784 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port f32cfc28-580f-41b9-bde1-3682c8975a1b completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:33.763655 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port f32cfc28-580f-41b9-bde1-3682c8975a1b triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:33.764028 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:33.779202 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:33.907952 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:33.946542 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port f32cfc28-580f-41b9-bde1-3682c8975a1b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=f32cfc28-580f-41b9-bde1-3682c8975a1b,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:33.975744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990f992f-128a-4f79-a662-dac3dcb4dce5 req-10823692-5aaf-431e-a548-f3543f972105 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:33.977299 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-990f992f-128a-4f79-a662-dac3dcb4dce5 req-10823692-5aaf-431e-a548-f3543f972105 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.1148221
May 20 16:23:34.010528 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:34.013447 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:34.039266 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-990f992f-128a-4f79-a662-dac3dcb4dce5 req-39178e08-b29f-4dd0-b361-3beab546b48f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0538628
May 20 16:23:34.095813 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=f32cfc28-580f-41b9-bde1-3682c8975a1b,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:34.100138 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:34.158850 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Router 93062e7a-bead-41af-9c53-263e03cf34ac is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92422) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:23:34.340357 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:23:34.348794 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:23:34.360315 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:34.361197 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71202b670>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:34.421789 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:34.423299 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.4939616
May 20 16:23:34.425965 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 36990) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:34.544444 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:34.840518 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71202b670>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:33Z', 'revision_number': 3, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:34.844735 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:23:34.845084 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Updating router 93062e7a-bead-41af-9c53-263e03cf34ac port 87b02c72-143f-485c-ad40-ea2a7cb6de7f binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:23:34.902590 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.159248 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.284100 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c595a54-d202-402d-b661-a9b3aa533cbb req-4f6c60bd-3170-4e4b-8572-f3540ea81fe0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:35.293475 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c595a54-d202-402d-b661-a9b3aa533cbb req-4f6c60bd-3170-4e4b-8572-f3540ea81fe0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.1233006
May 20 16:23:35.298079 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.333522 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Transition to ACTIVE for port object 87b02c72-143f-485c-ad40-ea2a7cb6de7f will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:35.341229 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8c595a54-d202-402d-b661-a9b3aa533cbb req-4273a4c4-1a35-46e8-91d7-b1e185b19f40 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463979
May 20 16:23:35.432995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.441918 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:35.452241 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Allocated IP 172.20.0.1 (a02876f9-a796-4512-9044-eb08bb5d54c6/cb578eb9-d6e8-4e33-8d08-43894fe771d7/86ac85fa-8a31-4e3a-b3db-3c8302d1748d) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:35.556429 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Attempting to bind port 87b02c72-143f-485c-ad40-ea2a7cb6de7f on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:35.556957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Attempting to bind port 87b02c72-143f-485c-ad40-ea2a7cb6de7f by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:35.557436 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Attempting to bind port 87b02c72-143f-485c-ad40-ea2a7cb6de7f on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:35.566633 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:35.567152 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:35.567595 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.567995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:35.568473 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Bound port: 87b02c72-143f-485c-ad40-ea2a7cb6de7f, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:35.568852 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.614092 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device f32cfc28-580f-41b9-bde1-3682c8975a1b up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:35.647698 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.664626 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Transition to ACTIVE for port object 86ac85fa-8a31-4e3a-b3db-3c8302d1748d will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:35.685193 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd5f46f9-3223-4335-a377-cc68876d416f None None] Pushing event updated for resources: {'Port': ['ID=87b02c72-143f-485c-ad40-ea2a7cb6de7f,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:35.699686 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-fd5f46f9-3223-4335-a377-cc68876d416f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:35.720192 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] For port 87b02c72-143f-485c-ad40-ea2a7cb6de7f, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:35.724333 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] For port 87b02c72-143f-485c-ad40-ea2a7cb6de7f, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=87b02c72-143f-485c-ad40-ea2a7cb6de7f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:35.733245 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port f32cfc28-580f-41b9-bde1-3682c8975a1b triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:35.733616 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.759496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.765059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:35.809280 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:35.820319 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:35.921025 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:35.921665 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71202b670>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:35.941556 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Pushing event updated for resources: {'Port': ['ID=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:35.951194 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:35.960752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Network a02876f9-a796-4512-9044-eb08bb5d54c6 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:35.961884 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:35.964078 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:36.001315 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd5f46f9-3223-4335-a377-cc68876d416f None None] Pushing event updated for resources: {'Port': ['ID=87b02c72-143f-485c-ad40-ea2a7cb6de7f,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:36.030009 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:36.051042 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-fd5f46f9-3223-4335-a377-cc68876d416f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:36.278642 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:36.323535 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:36.519828 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:36.529463 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-6aa7f551-968a-4a73-b8b2-3a5169d0ad68 None None] Provisioning for port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:36.550258 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-6aa7f551-968a-4a73-b8b2-3a5169d0ad68 None None] Provisioning complete for port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:36.550780 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6aa7f551-968a-4a73-b8b2-3a5169d0ad68 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:36.595562 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee772f9c-c44b-4342-90f3-eec1b7e62ff7 req-a67cd9b8-3724-4c98-a567-6575c047e51f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:36.597870 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ee772f9c-c44b-4342-90f3-eec1b7e62ff7 req-a67cd9b8-3724-4c98-a567-6575c047e51f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.1192265
May 20 16:23:36.622548 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:36.627119 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-6aa7f551-968a-4a73-b8b2-3a5169d0ad68 None None] Port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:23:36.669987 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-99a6ab04-70f7-4410-a55c-0e74a0b739e1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:36.672010 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ee772f9c-c44b-4342-90f3-eec1b7e62ff7 req-75830e21-aab8-40bf-98aa-e84dd2cce813 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0683064
May 20 16:23:36.725390 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71202b670>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:33Z', 'revision_number': 3, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:36.730107 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50e698e0-ca16-4d9c-9c47-9011a102bbc5 None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:33Z', 'revision_number': 3, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:23:36.747069 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:36.795231 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Pushing event updated for resources: {'Port': ['ID=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:36.798177 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:36.908494 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Network a02876f9-a796-4512-9044-eb08bb5d54c6 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:36.910291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:37.196468 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:23:37.269644 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-35a7dac9-bc3e-41af-aa11-b5039053370a None None] Provisioning complete for port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:37.270559 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-35a7dac9-bc3e-41af-aa11-b5039053370a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:37.348989 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-35a7dac9-bc3e-41af-aa11-b5039053370a None None] Port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:23:37.423412 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:23:37.434067 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] 10.222.0.64 "PUT /v2.0/routers/93062e7a-bead-41af-9c53-263e03cf34ac/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0068269
May 20 16:23:37.628995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 87b02c72-143f-485c-ad40-ea2a7cb6de7f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:38.060954 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81176e41-920a-450f-8e8c-d098469d2294 req-7b1ca9a1-e4a8-41d1-9d58-84e6714bff1b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:38.062994 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-81176e41-920a-450f-8e8c-d098469d2294 req-7b1ca9a1-e4a8-41d1-9d58-84e6714bff1b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.0974808
May 20 16:23:38.112725 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-81176e41-920a-450f-8e8c-d098469d2294 req-5d7ef403-a64e-471d-b78f-89a1f38e4227 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431097
May 20 16:23:38.307494 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 87b02c72-143f-485c-ad40-ea2a7cb6de7f completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:38.340131 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 87b02c72-143f-485c-ad40-ea2a7cb6de7f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:38.340131 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:38.452844 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:38.468694 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 87b02c72-143f-485c-ad40-ea2a7cb6de7f, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=87b02c72-143f-485c-ad40-ea2a7cb6de7f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:38.573319 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:23:38.583338 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:38.583994 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712d405e0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:38.798435 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:38.886954 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Request body: {'port': {'device_id': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:39.001176 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.107016 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712d405e0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 2, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:39.111130 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:23:39.111606 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Updating router 93062e7a-bead-41af-9c53-263e03cf34ac port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:23:39.167142 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.323545 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.323545 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:39.382692 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 16ee028f-977c-4c03-a101-a688c6953d30 {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:23:39.393611 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.404183 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=87b02c72-143f-485c-ad40-ea2a7cb6de7f,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:39.407938 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:39.416624 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Transition to ACTIVE for port object 16ee028f-977c-4c03-a101-a688c6953d30 will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:39.453729 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045841e9-3398-4ce4-9815-20d2ff9d18ae req-680f0717-d2aa-4d5e-859c-70924568541f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:39.455212 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-045841e9-3398-4ce4-9815-20d2ff9d18ae req-680f0717-d2aa-4d5e-859c-70924568541f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 932 time: 0.2337081
May 20 16:23:39.501207 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-045841e9-3398-4ce4-9815-20d2ff9d18ae req-3ec9b441-4ef1-410c-8a41-7792575fea85 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398946
May 20 16:23:39.540304 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.552690 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Transition to ACTIVE for port object 86ac85fa-8a31-4e3a-b3db-3c8302d1748d will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:39.570507 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.571675 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 87b02c72-143f-485c-ad40-ea2a7cb6de7f up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:39.575567 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-68ee2dfb-27ba-42da-bd90-29a9a3c53fc1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:39.645791 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 87b02c72-143f-485c-ad40-ea2a7cb6de7f triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:39.645791 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.685304 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.695279 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-7d8f06e5-f8b2-421e-95fb-8caef1daff9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:39.695939 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37018) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:39.703449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1981266298-network', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:39.711908 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:39.723759 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Usage tracker for resource:network and tenant:3c8d0c7d5c7f420f878c3ea95df7af77 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:39.732288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:39.740686 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:39.852289 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Pushing event updated for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:39.860403 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:39.861705 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Made reservation on behalf of 3c8d0c7d5c7f420f878c3ea95df7af77 for: {'network': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:23:39.864274 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1000848'] for network, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.865330 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee195c9-24f4-46e9-ae8b-accf2c0a8345 None None] Pushing event updated for resources: {'Port': ['ID=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:39.869046 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-cee195c9-24f4-46e9-ae8b-accf2c0a8345 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:39.882219 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:39.901108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:39.906075 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Usage tracker for resource:security_group_rule and tenant:3c8d0c7d5c7f420f878c3ea95df7af77 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:39.910161 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:39.918822 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:39.972052 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Attempting to bind port 16ee028f-977c-4c03-a101-a688c6953d30 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:39.972645 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Attempting to bind port 16ee028f-977c-4c03-a101-a688c6953d30 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:39.972789 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Attempting to bind port 16ee028f-977c-4c03-a101-a688c6953d30 on network 1c714e06-ccca-4a05-8bd6-477318017820 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:39.989515 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Port 16ee028f-977c-4c03-a101-a688c6953d30 on network 1c714e06-ccca-4a05-8bd6-477318017820 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:23:39.990606 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Attempting to bind port 16ee028f-977c-4c03-a101-a688c6953d30 on network 1c714e06-ccca-4a05-8bd6-477318017820 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:40.009784 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:40.014734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Checking segment: {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:40.014734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Bound using segment: {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:40.014734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Bound port: 16ee028f-977c-4c03-a101-a688c6953d30, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6dfff34b-4d7f-4dbe-be5c-23338c108e5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:40.014734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.024778 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Attempting to bind port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:40.025194 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Attempting to bind port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:40.025565 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Attempting to bind port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:40.037637 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:40.037936 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Checking segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:40.038345 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.038735 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Bound using segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:40.043395 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Bound port: 86ac85fa-8a31-4e3a-b3db-3c8302d1748d, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:40.043900 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.054366 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.138970 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:40.142055 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=16ee028f-977c-4c03-a101-a688c6953d30,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:40.148438 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] For port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:40.151411 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] For port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:40.157317 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.163534 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-8d4c4900-e34e-491a-8181-4276534788b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:40.190862 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] vlan segment allocate from pool success with {'vlan_id': 642, 'physical_network': 'physnet1'}  {{(pid=92421) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 16:23:40.196082 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f60fd76-304b-4f6e-b8b2-8accc12c522f,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:40.200619 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:40.204817 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.205135 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.segments_db [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Added segment a1311d2e-3e3b-40e6-b792-506a50d6801e of type vlan for network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e
May 20 16:23:40.232228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789402858195'] for network, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.256327 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.261138 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ac53c010-214d-4d77-9104-6c322b35ed3f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:40.296441 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.301317 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:40.319644 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:40.320329 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.321746 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] 10.222.0.16 "PUT /v2.0/ports/16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 1094 time: 1.4395487
May 20 16:23:40.322262 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:23:40.346180 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Pushing event updated for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:40.350958 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:40.375536 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:40.376267 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712d405e0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:40.387392 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30', 'status': 'completed', 'code': 200}
May 20 16:23:40.399306 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578'] for network, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.400990 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:40.401828 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.405960 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-61926f18-00b2-4546-a134-0b5aef2d7e3a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:40.485309 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee195c9-24f4-46e9-ae8b-accf2c0a8345 None None] Pushing event updated for resources: {'Port': ['ID=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,revision_number=4']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:40.529484 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Pushing event updated for resources: {'Network': ['ID=7f41ce1a-7a56-4bba-ba7c-09fac47ee28e,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:40.534203 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:40.540735 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-cee195c9-24f4-46e9-ae8b-accf2c0a8345 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:40.541959 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e details requested by agent ovs-agent-dv-cinder-689486-13-iscsi with host dv-cinder-689486-13-iscsi {{(pid=92423) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 16:23:40.601106 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:40.677309 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] 10.222.0.64 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.9793723
May 20 16:23:40.680001 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37028) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:40.685837 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Request body: {'subnet': {'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1981266298-subnet', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'ip_version': 4}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:40.690554 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:40.695144 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Usage tracker for resource:subnet and tenant:3c8d0c7d5c7f420f878c3ea95df7af77 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:40.698407 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:40.713236 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:40.728838 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b6d54e-b1ef-4f88-9ba3-c2f4ff58e350 req-1fd3fbba-235a-484e-b4f0-c90b348423db tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:40.730373 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-04b6d54e-b1ef-4f88-9ba3-c2f4ff58e350 req-1fd3fbba-235a-484e-b4f0-c90b348423db tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 944 time: 0.0914581
May 20 16:23:40.780739 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-04b6d54e-b1ef-4f88-9ba3-c2f4ff58e350 req-439bdbf1-a316-47b0-af36-5e54716c1bbc tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441320
May 20 16:23:40.844403 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Made reservation on behalf of 3c8d0c7d5c7f420f878c3ea95df7af77 for: {'subnet': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:23:40.846755 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6223402'] for subnet, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:40.943710 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712d405e0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:40Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:40.947557 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cf8e829-042a-4b63-abab-6727efffe408 None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:40Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:23:41.372937 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6358878', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6223416'] for subnet, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:41.376939 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-49ae8f6b-611d-4cf1-b44a-46b14b6044a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:41.444825 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Pushing event updated for resources: {'Subnet': ['ID=c09265b7-ec8d-4c31-a44d-34f0aaf15d57,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:41.449407 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:41.459341 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Checking segment: {'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:41.459741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Network hostable DHCP agents. Network: 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e, hostable agents: ['67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577'], hosted agents: [] {{(pid=92422) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 16:23:41.586959 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 86ac85fa-8a31-4e3a-b3db-3c8302d1748d up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:41.673404 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e is scheduled to be hosted by DHCP agent 67fdf4d4-a9a7-4c69-9bcf-a422b4c9b577 with binding_index 1 {{(pid=92422) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 16:23:41.736142 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:41.741394 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:41.741780 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:41.796197 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-689486-13-iscsi, 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e) {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:41.817303 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:41.818013 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:41.890956 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5dd7266-54e5-4b0f-add7-109254d703ab req-b74d63b0-8b84-4699-ac7e-23033e35cb54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:41.893423 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e5dd7266-54e5-4b0f-add7-109254d703ab req-b74d63b0-8b84-4699-ac7e-23033e35cb54 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1097 time: 0.1444654
May 20 16:23:41.944224 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e9717666-a344-4d54-9239-1b292228cade admin admin] 10.222.0.64 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.2621045
May 20 16:23:41.944434 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21bb0202-9dec-447e-a223-e9d9d082c8bd None None] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:23:41.951692 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37040) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:41.966205 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:23:41.969433 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:42.024578 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:42.027423 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-557dd02e-f66b-4ece-9422-296a03b7418b req-3e4d3314-cbf0-4ec1-aa58-40142ede2523 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:42.029060 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-557dd02e-f66b-4ece-9422-296a03b7418b req-3e4d3314-cbf0-4ec1-aa58-40142ede2523 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 944 time: 0.1188591
May 20 16:23:42.040071 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Usage tracker for resource:router and tenant:3c8d0c7d5c7f420f878c3ea95df7af77 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:42.050122 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:42.058252 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.059789 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:42.092760 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-557dd02e-f66b-4ece-9422-296a03b7418b req-51da6421-08e3-4b59-9ea1-243b7aab6fd9 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0576251
May 20 16:23:42.097916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5dd7266-54e5-4b0f-add7-109254d703ab req-608baab8-4cb3-470b-94a9-2be1f32755e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:42.099356 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e5dd7266-54e5-4b0f-add7-109254d703ab req-608baab8-4cb3-470b-94a9-2be1f32755e8 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=8614158322ae423bb16b1c0645c66cf9&shared=False HTTP/1.1" status: 200  len: 916 time: 0.1968503
May 20 16:23:42.115571 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:42.205024 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8332959', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-62588'] for router, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.206026 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8328073', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8306398', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7877434', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-62469'] for router, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.217327 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe1bdbe7e-8413-5ef3-a43e-5926a19ada3c-7f41ce1a-7a56-4bba-ba7c-09fac47ee28e', 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'fixed_ips': [{'subnet_id': 'c09265b7-ec8d-4c31-a44d-34f0aaf15d57'}]}} from dv-cinder-689486-13-iscsi. {{(pid=92423) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 16:23:42.218164 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.235516 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.237413 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-2d4ee31b-5d1e-41fb-9265-9528e6c997dd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:42.249868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.261671 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5dd7266-54e5-4b0f-add7-109254d703ab req-64dc4a35-4e74-47fa-827b-04479ce89137 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:42.263122 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e5dd7266-54e5-4b0f-add7-109254d703ab req-64dc4a35-4e74-47fa-827b-04479ce89137 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1566715
May 20 16:23:42.367918 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:42.372846 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:42.374679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-bc4bdbda-32d4-4a40-9d3a-9018ec0bbd48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:42.376190 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-bc4bdbda-32d4-4a40-9d3a-9018ec0bbd48 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1097 time: 0.0768330
May 20 16:23:42.432918 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.db_base_plugin_common [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Allocated IP 172.20.0.2 (7f41ce1a-7a56-4bba-ba7c-09fac47ee28e/c09265b7-ec8d-4c31-a44d-34f0aaf15d57/ab96237e-ff01-4a95-8839-5179d7ad57b1) {{(pid=92423) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:42.641288 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Notify callbacks [] for port, precommit_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.651639 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Transition to ACTIVE for port object ab96237e-ff01-4a95-8839-5179d7ad57b1 will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:42.669875 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Transition to ACTIVE for port object ab96237e-ff01-4a95-8839-5179d7ad57b1 will not be triggered until provisioned by entity DHCP. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:42.698343 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-92a6a20d-52e2-47e1-ba44-a3d384ae83fc service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 217 time: 0.2013133
May 20 16:23:42.780505 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974'] for port, after_create {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.784288 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:42.809402 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8306412', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8332937', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-62487'] for router, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.827351 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-6cb572f9-fe35-4b7c-8a14-7600b9f24629 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:42.828836 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-6cb572f9-fe35-4b7c-8a14-7600b9f24629 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 200  len: 854 time: 0.1225975
May 20 16:23:42.850095 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e is already hosted by enough agents. {{(pid=92423) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:42.852899 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.scheduler.base_scheduler [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Resources bound (agent type, host, resource id):  {{(pid=92423) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:42.856407 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Received port after_create {{(pid=92423) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:42.862369 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Pushing event updated for resources: {'Port': ['ID=ab96237e-ff01-4a95-8839-5179d7ad57b1,revision_number=1']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:42.866921 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:42.944728 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-70bb8e73-a3e2-4fd6-b0cc-1ba9b9d6c0a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:42.946158 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-70bb8e73-a3e2-4fd6-b0cc-1ba9b9d6c0a9 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1c714e06-ccca-4a05-8bd6-477318017820&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1103663
May 20 16:23:42.952449 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Attempting to bind port ab96237e-ff01-4a95-8839-5179d7ad57b1 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:42.952942 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Attempting to bind port ab96237e-ff01-4a95-8839-5179d7ad57b1 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:42.953420 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Attempting to bind port ab96237e-ff01-4a95-8839-5179d7ad57b1 on network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:42.958943 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:42.959354 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Checking segment: {'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:42.959795 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:42.960314 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Bound using segment: {'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:42.960817 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Bound port: ab96237e-ff01-4a95-8839-5179d7ad57b1, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:42.961191 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:43.054576 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] For port ab96237e-ff01-4a95-8839-5179d7ad57b1, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:43.057826 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] For port ab96237e-ff01-4a95-8839-5179d7ad57b1, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ab96237e-ff01-4a95-8839-5179d7ad57b1,segment=NetworkSegment(a1311d2e-3e3b-40e6-b792-506a50d6801e),segment_id=a1311d2e-3e3b-40e6-b792-506a50d6801e)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:43.149343 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-3b419d94-aaa0-453f-8abf-f5f8be4be238 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1554098
May 20 16:23:43.193722 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:43.202083 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:43.310751 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac962de5-aa22-406d-a424-126e5a8083ea req-5c0d9816-3fd8-4e53-9d43-45a60dfe36fb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:43.312649 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac962de5-aa22-406d-a424-126e5a8083ea req-5c0d9816-3fd8-4e53-9d43-45a60dfe36fb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 944 time: 0.1125932
May 20 16:23:43.323036 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Pushing event updated for resources: {'Port': ['ID=ab96237e-ff01-4a95-8839-5179d7ad57b1,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:43.327095 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:43.370833 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac962de5-aa22-406d-a424-126e5a8083ea req-1d1fe029-526e-4694-ad6c-d5ee8d2554fe tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515010
May 20 16:23:43.438455 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:43.474092 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:43.477598 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a02ec17a-7a98-45c7-8011-51459ad1ba11 req-11538e6c-021c-433e-8142-d27f34e6aae8 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2797155
May 20 16:23:43.669635 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Allocated IP 172.27.0.15 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/ee2018aa-6613-4ac5-83ac-f85e6ec6201a) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:43.717928 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ab96237e-ff01-4a95-8839-5179d7ad57b1 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:43.827673 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:43.838549 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port ab96237e-ff01-4a95-8839-5179d7ad57b1 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:43.843997 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 86ac85fa-8a31-4e3a-b3db-3c8302d1748d up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:43.915078 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:43.915416 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:43.969298 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:43.975437 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4e47d543-c272-4f9a-8d70-d3cc0906833d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:44.035499 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:44.040062 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:44.042570 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:44.109024 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Pushing event updated for resources: {'Port': ['ID=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:44.112304 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:44.275127 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1323f8e0-521e-4028-a716-06fa9958d946 None None] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:23:44.489306 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] Provisioning for port ab96237e-ff01-4a95-8839-5179d7ad57b1 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:44.500146 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] Provisioning complete for port ab96237e-ff01-4a95-8839-5179d7ad57b1 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:44.500521 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:44.566681 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447267dc-6f64-4c61-bbfe-462b319755c1 req-dece1a1a-b97b-465b-9f8b-0683cff5afa1 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:44.568302 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-447267dc-6f64-4c61-bbfe-462b319755c1 req-dece1a1a-b97b-465b-9f8b-0683cff5afa1 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 944 time: 0.0872955
May 20 16:23:44.622299 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-447267dc-6f64-4c61-bbfe-462b319755c1 req-094f76a9-9c7e-49ab-9a15-77f7f55cdb23 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476334
May 20 16:23:44.680055 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:44.714976 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] For port ab96237e-ff01-4a95-8839-5179d7ad57b1, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ab96237e-ff01-4a95-8839-5179d7ad57b1,segment=NetworkSegment(a1311d2e-3e3b-40e6-b792-506a50d6801e),segment_id=a1311d2e-3e3b-40e6-b792-506a50d6801e)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:44.718748 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:44.810125 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:44.811912 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9bd95791-29b1-4387-bd29-6f552aacef95 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:44.878685 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] Pushing event updated for resources: {'Port': ['ID=ab96237e-ff01-4a95-8839-5179d7ad57b1,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:44.881736 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f865b7c9-a1cf-4559-91fe-95dd25a53cae None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:44.929491 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-d6242777-68ee-471c-a61e-34c8c1134c05 None None] Provisioning complete for port ab96237e-ff01-4a95-8839-5179d7ad57b1 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:44.930200 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d6242777-68ee-471c-a61e-34c8c1134c05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:45.067259 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8332944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8306356'] for router, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:45.375738 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Router f5f03d8e-8074-4a54-9b67-292c322d1f4f is scheduled to L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 with binding_index 1 {{(pid=92422) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 16:23:45.549962 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:23:45.560025 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Sync routers for ids ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:23:45.570704 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Routers {'f5f03d8e-8074-4a54-9b67-292c322d1f4f'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:45.571451 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7124bf400>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:45.622624 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ab96237e-ff01-4a95-8839-5179d7ad57b1 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:45.650321 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:45.652375 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] 10.222.0.64 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.6992099
May 20 16:23:45.654443 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37058) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:45.800417 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port ab96237e-ff01-4a95-8839-5179d7ad57b1 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:45.800794 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:45.833307 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff8f49fe-7c4c-4e51-b224-a40f65c0539f req-eddf9ecc-d362-456c-9ffc-6575404d34c7 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:45.835687 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff8f49fe-7c4c-4e51-b224-a40f65c0539f req-eddf9ecc-d362-456c-9ffc-6575404d34c7 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 944 time: 0.0925872
May 20 16:23:45.855366 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Set router f5f03d8e-8074-4a54-9b67-292c322d1f4f gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:45.883667 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff8f49fe-7c4c-4e51-b224-a40f65c0539f req-9fcb2fc2-384c-4fc1-92b9-f9c6a3bad37e tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429924
May 20 16:23:46.120786 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-df437083-162f-437a-a1ff-5e3ff7686e6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.221558 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7124bf400>, [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:23:44Z', 'revision_number': 3, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:46.226285 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Checking router: f5f03d8e-8074-4a54-9b67-292c322d1f4f for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:23:46.226689 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Updating router f5f03d8e-8074-4a54-9b67-292c322d1f4f port ee2018aa-6613-4ac5-83ac-f85e6ec6201a binding host dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:23:46.286954 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.462219 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.638148 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Notify callbacks [] for port, precommit_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.658487 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Transition to ACTIVE for port object ee2018aa-6613-4ac5-83ac-f85e6ec6201a will not be triggered until provisioned by entity L2. {{(pid=92423) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:46.671805 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Allocated IP 172.20.0.1 (7f41ce1a-7a56-4bba-ba7c-09fac47ee28e/c09265b7-ec8d-4c31-a44d-34f0aaf15d57/e6c1dc32-2719-4c4c-b313-b944d4fcaaa9) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:23:46.734806 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.739372 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-c71cdf82-a371-4960-9966-ba241436bff4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:46.820618 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Attempting to bind port ee2018aa-6613-4ac5-83ac-f85e6ec6201a on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:46.822035 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Attempting to bind port ee2018aa-6613-4ac5-83ac-f85e6ec6201a by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:46.822035 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Attempting to bind port ee2018aa-6613-4ac5-83ac-f85e6ec6201a on network d2ac176c-a21a-4087-9111-35a566c1f2ad {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:46.823447 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Pushing event updated for resources: {'Port': ['ID=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,revision_number=2']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:46.826011 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.833160 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:46.833537 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Checking segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92423) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:46.833944 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.834338 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Bound using segment: {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'} {{(pid=92423) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:46.834811 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.managers [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Bound port: ee2018aa-6613-4ac5-83ac-f85e6ec6201a, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '994c7083-9ec0-4a20-afb4-ae32a10fcc1c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}}] {{(pid=92423) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:46.835208 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.842158 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Transition to ACTIVE for port object e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:46.865018 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.865599 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.865719 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.866032 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.866358 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.866684 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.867006 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.867525 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.867846 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.868165 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.868484 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.868805 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:23:46.877464 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:46.919634 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] For port ee2018aa-6613-4ac5-83ac-f85e6ec6201a, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92423) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:46.923212 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] For port ee2018aa-6613-4ac5-83ac-f85e6ec6201a, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:46.936148 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:46.941153 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-637d3ffe-d988-4fad-9bf1-7485e838690c tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:46.999457 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:47.004601 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:47.007851 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:47.010871 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:47.014669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:23:47.053954 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Pushing event updated for resources: {'Port': ['ID=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:47.088419 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:47.094330 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8331693'] for router_interface, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:47.114730 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-903ffbbc-afd2-44f4-ba51-775e1c8e0463 req-d34d1349-f7bd-4b9d-a3cf-d8c8f525287a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:47.116403 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-903ffbbc-afd2-44f4-ba51-775e1c8e0463 req-d34d1349-f7bd-4b9d-a3cf-d8c8f525287a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 944 time: 0.1238279
May 20 16:23:47.129619 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Routers {'f5f03d8e-8074-4a54-9b67-292c322d1f4f'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:47.130246 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7124bf400>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:47.188922 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-903ffbbc-afd2-44f4-ba51-775e1c8e0463 req-f508b4c5-5745-46e8-9c72-838afc61fdc9 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0609782
May 20 16:23:47.218629 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Pushing event updated for resources: {'Port': ['ID=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,revision_number=3']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:47.224535 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:47.319224 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:47.335969 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] Set router f5f03d8e-8074-4a54-9b67-292c322d1f4f gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:47.449219 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-2b2e91f3-aad7-4883-904c-ea9182d8f2e7 None None] Provisioning for port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:47.477445 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-2b2e91f3-aad7-4883-904c-ea9182d8f2e7 None None] Provisioning complete for port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:47.477846 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2b2e91f3-aad7-4883-904c-ea9182d8f2e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:47.564123 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:47.610033 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-2b2e91f3-aad7-4883-904c-ea9182d8f2e7 None None] Port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:23:47.627005 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:47.654318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a6aa086f-44d0-4cd0-a192-6838e6d72e97 tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:47.695970 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7124bf400>, [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:23:44Z', 'revision_number': 3, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:47.699838 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f78cdb-505a-42b9-a702-03a00738a689 None None] The sync data for ids ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'] in dv-cinder-689486-13-iscsi is: [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:23:44Z', 'revision_number': 3, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:23:47.732430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Pushing event updated for resources: {'Port': ['ID=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:47.736919 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:47.737676 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8347464', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8302614'] for router_interface, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:47.875973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:23:47.877307 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:23:48.044658 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 16ee028f-977c-4c03-a101-a688c6953d30 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:23:48.177120 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Router f5f03d8e-8074-4a54-9b67-292c322d1f4f has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:23:48.210533 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=16ee028f-977c-4c03-a101-a688c6953d30,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:48.235996 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '16ee028f-977c-4c03-a101-a688c6953d30', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'port_id': '16ee028f-977c-4c03-a101-a688c6953d30', 'mac_address': 'fa:16:3e:d0:d2:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 644, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:23:48.297730 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-c021d138-e94c-4de2-8573-9471204fec9d None None] Provisioning complete for port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:48.300667 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c021d138-e94c-4de2-8573-9471204fec9d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:48.365853 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:48.411295 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 16ee028f-977c-4c03-a101-a688c6953d30 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:23:48.419110 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:23:48.420259 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-c021d138-e94c-4de2-8573-9471204fec9d None None] Port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:23:48.433692 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccffddd-c8d9-4173-8096-0c24a6375912 req-f97fc235-7f89-4b41-bd68-872066d7e5d2 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:48.435234 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2ccffddd-c8d9-4173-8096-0c24a6375912 req-f97fc235-7f89-4b41-bd68-872066d7e5d2 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 944 time: 0.1194870
May 20 16:23:48.438621 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=16ee028f-977c-4c03-a101-a688c6953d30,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:48.441767 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] 10.222.0.64 "PUT /v2.0/routers/f5f03d8e-8074-4a54-9b67-292c322d1f4f/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7861836
May 20 16:23:48.461823 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:48.488087 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2ccffddd-c8d9-4173-8096-0c24a6375912 req-007c0ff6-a1df-4350-a2eb-035112ae46c1 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449009
May 20 16:23:48.535937 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:48.539034 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-3b9b3143-d057-4ac8-8746-ec26734ff8a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:48.618450 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:48.621568 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:48.684680 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87c4ffa6-42f0-41be-95ba-3de61fb52028 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:48.937436 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['16ee028f-977c-4c03-a101-a688c6953d30'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:23:49.120064 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37092) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:49.125613 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-193855468', 'description': 'tempest-secgroup-smoke-193855468 description', 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:49.131564 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:49.135891 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:49.138707 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:49.144337 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:49.232923 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.254464 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:49.258429 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:49.261325 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:49.267359 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:49.338324 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.353688 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Sync routers for ids ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:23:49.362988 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Routers {'f5f03d8e-8074-4a54-9b67-292c322d1f4f'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:49.364210 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712831220>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:49.454286 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.459564 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:49.498043 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'SecurityGroup': ['ID=da77fa6e-aadb-4acb-8e30-527bbdccd591,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:49.502714 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:49.543049 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Set router f5f03d8e-8074-4a54-9b67-292c322d1f4f gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:49.639415 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.644057 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.5228937
May 20 16:23:49.645076 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37100) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:49.651745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ee2018aa-6613-4ac5-83ac-f85e6ec6201a up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:49.652649 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'security_group_rule': {'security_group_id': 'da77fa6e-aadb-4acb-8e30-527bbdccd591', 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:49.659031 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:49.664157 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:49.667422 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:49.674254 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:49.690065 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.739882 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7851b-9563-4cd8-ac86-218911b077c3 req-c967097c-1b86-4009-a28e-7aade82f5365 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:49.741551 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5bd7851b-9563-4cd8-ac86-218911b077c3 req-c967097c-1b86-4009-a28e-7aade82f5365 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 945 time: 0.1194096
May 20 16:23:49.789176 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5bd7851b-9563-4cd8-ac86-218911b077c3 req-b4ca3706-d26d-4d23-9f9b-ef645165b9b0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398192
May 20 16:23:49.838598 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.849941 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port ee2018aa-6613-4ac5-83ac-f85e6ec6201a completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:49.855042 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port ee2018aa-6613-4ac5-83ac-f85e6ec6201a triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:49.855534 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.866405 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712831220>, [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:23:47Z', 'revision_number': 4, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'e6c1dc32-2719-4c4c-b313-b944d4fcaaa9', 'name': '', 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'mac_address': 'fa:16:3e:99:8e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'c09265b7-ec8d-4c31-a44d-34f0aaf15d57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:46Z', 'updated_at': '2021-05-20T16:23:47Z', 'revision_number': 2, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'subnets': [{'id': 'c09265b7-ec8d-4c31-a44d-34f0aaf15d57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:49.870450 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Checking router: f5f03d8e-8074-4a54-9b67-292c322d1f4f for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:23:49.870912 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Updating router f5f03d8e-8074-4a54-9b67-292c322d1f4f port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 binding host dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 16:23:49.906723 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.923869 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.979298 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:49.995901 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port ee2018aa-6613-4ac5-83ac-f85e6ec6201a, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:50.010002 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.012113 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d71bf8fb-886f-43eb-b57b-c96884e706d5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:50.034374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f68b5c6-f9f4-49c2-af94-6135f45709e2,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:50.037572 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:50.041429 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 16ee028f-977c-4c03-a101-a688c6953d30 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:50.128386 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.131274 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-fd5f46f9-3223-4335-a377-cc68876d416f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:50.141661 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.146045 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4968133
May 20 16:23:50.146435 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37104) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:50.152097 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'security_group_rule': {'security_group_id': 'da77fa6e-aadb-4acb-8e30-527bbdccd591', 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:50.158047 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:50.163026 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:50.166065 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:50.172190 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:50.203007 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:50.205745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 16ee028f-977c-4c03-a101-a688c6953d30 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:50.209755 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:50.212559 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 16ee028f-977c-4c03-a101-a688c6953d30 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:50.212937 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.276143 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.276358 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Notify callbacks [] for port, precommit_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.288255 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.provisioning_blocks [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Transition to ACTIVE for port object e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 will not be triggered until provisioned by entity L2. {{(pid=92424) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:23:50.335275 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.372174 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.393041 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.397710 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:50.399838 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:23:50.410377 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=16ee028f-977c-4c03-a101-a688c6953d30,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:50.425929 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.425929 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f24c4d14-9dd2-441f-b04c-bd05d1168c9f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:50.446252 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30', 'code': 200}
May 20 16:23:50.448263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=71ee89c3-171c-495b-af7a-659ada456efe,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:50.452539 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:50.524537 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.526715 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:50.535438 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8ed31d-ef10-4564-84e0-b788a5a56889 None None] Pushing event updated for resources: {'Port': ['ID=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,revision_number=3']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:50.539590 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-ed8ed31d-ef10-4564-84e0-b788a5a56889 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:50.553915 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.557945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37110) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:50.558103 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4104230
May 20 16:23:50.567312 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'security_group_rule': {'security_group_id': 'da77fa6e-aadb-4acb-8e30-527bbdccd591', 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:50.574381 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:50.579729 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:50.583532 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:50.591525 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:50.617874 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:50.621178 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:50.634731 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Attempting to bind port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 on host dv-cinder-689486-13-iscsi for vnic_type normal with profile  {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:23:50.635095 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Attempting to bind port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 by drivers openvswitch,hyperv on host dv-cinder-689486-13-iscsi at level 0 using segments [{'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:23:50.635477 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Attempting to bind port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 on network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:23:50.641917 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Checking agent: {'id': '3de629ea-0995-4e76-bd09-720229a54de1', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-689486-13-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 8, 48), 'started_at': datetime.datetime(2021, 5, 20, 16, 9, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-689486-13-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:23:50.642628 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Checking segment: {'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92424) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:23:50.643249 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.643694 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Bound using segment: {'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'} {{(pid=92424) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:23:50.644334 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.managers [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Bound port: e6c1dc32-2719-4c4c-b313-b944d4fcaaa9, host: dv-cinder-689486-13-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a1311d2e-3e3b-40e6-b792-506a50d6801e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e'}}] {{(pid=92424) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:23:50.645115 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.709345 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.771889 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] For port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9, host dv-cinder-689486-13-iscsi, cleared binding levels {{(pid=92424) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:23:50.775110 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.plugins.ml2.db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] For port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9, host dv-cinder-689486-13-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,segment=NetworkSegment(a1311d2e-3e3b-40e6-b792-506a50d6801e),segment_id=a1311d2e-3e3b-40e6-b792-506a50d6801e)] {{(pid=92424) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:23:50.792286 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.846857 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf1c673-bb8d-4d66-b670-7ce03d3cc389 req-644cf4ed-d0b0-416b-a85c-4a63de189099 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:50.849035 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2bf1c673-bb8d-4d66-b670-7ce03d3cc389 req-644cf4ed-d0b0-416b-a85c-4a63de189099 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1099 time: 0.0715134
May 20 16:23:50.877716 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron_lib.callbacks.manager [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92424) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.882963 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:50.895343 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-2bf1c673-bb8d-4d66-b670-7ce03d3cc389 req-edab3068-4d75-49bd-b23d-83f5e35f33f5 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384998
May 20 16:23:50.934992 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:50.950858 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d084c2ca-52e6-4e55-a0f9-560c05d8e3d1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:50.955264 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Routers {'f5f03d8e-8074-4a54-9b67-292c322d1f4f'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:23:50.955876 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712831220>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:50.985055 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2dfb1ce1-ef29-469b-ab2c-8c0920c8bfea,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:51.000816 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:51.020429 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8ed31d-ef10-4564-84e0-b788a5a56889 None None] Pushing event updated for resources: {'Port': ['ID=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,revision_number=4']} {{(pid=92424) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:51.022885 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac981136-0f27-4ce7-a38c-b69860b46e66 req-bf205c61-805a-4423-8dd5-bbf2e476cd5a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:51.024655 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac981136-0f27-4ce7-a38c-b69860b46e66 req-bf205c61-805a-4423-8dd5-bbf2e476cd5a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.1264827
May 20 16:23:51.024888 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG oslo_concurrency.lockutils [None req-ed8ed31d-ef10-4564-84e0-b788a5a56889 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:51.075349 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ac981136-0f27-4ce7-a38c-b69860b46e66 req-a1f88ce1-f053-481d-9fc9-16e08a387b6d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438373
May 20 16:23:51.088892 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.090516 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-1d383511-7eaf-454b-9ba7-b995a95290af tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.5311263
May 20 16:23:51.093428 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37118) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:51.099459 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'security_group_rule': {'security_group_id': 'da77fa6e-aadb-4acb-8e30-527bbdccd591', 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:51.105856 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:51.110241 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:51.113718 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:51.125997 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:51.149442 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] Set router f5f03d8e-8074-4a54-9b67-292c322d1f4f gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:23:51.250893 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.284491 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.319562 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.385964 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.393714 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:51.411758 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd934527-f289-4dfc-93f8-86f018977fb4,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:51.414324 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:51.461129 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712831220>, [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:23:47Z', 'revision_number': 4, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'e6c1dc32-2719-4c4c-b313-b944d4fcaaa9', 'name': '', 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'mac_address': 'fa:16:3e:99:8e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'c09265b7-ec8d-4c31-a44d-34f0aaf15d57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:46Z', 'updated_at': '2021-05-20T16:23:50Z', 'revision_number': 4, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'subnets': [{'id': 'c09265b7-ec8d-4c31-a44d-34f0aaf15d57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:23:51.464869 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c053121-c063-4905-945b-d3e9ee279685 None None] The sync data for ids ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'] in dv-cinder-689486-13-iscsi is: [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:23:47Z', 'revision_number': 4, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': 'e6c1dc32-2719-4c4c-b313-b944d4fcaaa9', 'name': '', 'network_id': '7f41ce1a-7a56-4bba-ba7c-09fac47ee28e', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'mac_address': 'fa:16:3e:99:8e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'c09265b7-ec8d-4c31-a44d-34f0aaf15d57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:46Z', 'updated_at': '2021-05-20T16:23:50Z', 'revision_number': 4, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'subnets': [{'id': 'c09265b7-ec8d-4c31-a44d-34f0aaf15d57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:23:51.507015 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.509524 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-505964ae-2d64-49eb-9bd3-613d690b408a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4134774
May 20 16:23:51.510927 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37122) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:51.517194 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'security_group_rule': {'security_group_id': 'da77fa6e-aadb-4acb-8e30-527bbdccd591', 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:51.526882 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:51.528727 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:51.536897 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:51.543343 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:51.627588 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.securitygroups_db [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Project a6bd88ff65e9420a8ccb36968532c4f6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 16:23:51.634954 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.700432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:51.714194 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.798654 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.801427 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:51.824663 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=22751060-48c0-4715-93e8-5d4f725b3c85,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:51.827299 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:51.867174 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning for port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:23:51.872245 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:51.872624 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.947500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:51.949067 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.4375532
May 20 16:23:51.951918 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37128) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:23:51.958031 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'security_group_rule': {'security_group_id': 'da77fa6e-aadb-4acb-8e30-527bbdccd591', 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:23:51.964657 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:23:51.968884 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:security_group_rule and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:23:51.975353 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:23:51.982769 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:23:51.996735 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:52.034802 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] For port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,segment=NetworkSegment(a1311d2e-3e3b-40e6-b792-506a50d6801e),segment_id=a1311d2e-3e3b-40e6-b792-506a50d6801e)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:23:52.136947 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.securitygroups_db [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Project a6bd88ff65e9420a8ccb36968532c4f6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 16:23:52.143841 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:52.171629 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:52.172874 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ee2018aa-6613-4ac5-83ac-f85e6ec6201a up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:52.223586 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:52.265957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:52.301760 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0947a35c-45f9-4ae6-a5c6-88c2e9657400 req-018ab77f-723e-4438-8f56-e0ad839be5c7 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:52.304066 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0947a35c-45f9-4ae6-a5c6-88c2e9657400 req-018ab77f-723e-4438-8f56-e0ad839be5c7 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.1107364
May 20 16:23:52.305845 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:52.308409 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:23:52.334690 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e129785-eacd-4086-a755-ad83e8acee35,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:52.337650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:52.343129 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port ee2018aa-6613-4ac5-83ac-f85e6ec6201a triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:52.343654 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:52.358321 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0947a35c-45f9-4ae6-a5c6-88c2e9657400 req-e26f6b15-4396-4cd6-90b2-b9ef8007a974 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476503
May 20 16:23:52.380683 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Pushing event updated for resources: {'Port': ['ID=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:23:52.381833 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:23:52.421733 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:52.426055 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4698436
May 20 16:23:53.552797 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf02171-e8fc-494c-96e6-a2391186a6dd req-f9b55d56-e541-4ae1-8b3d-7c5b7d40067e tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:53.554333 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf02171-e8fc-494c-96e6-a2391186a6dd req-f9b55d56-e541-4ae1-8b3d-7c5b7d40067e tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.0859029
May 20 16:23:53.601615 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 up at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:23:53.607168 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf02171-e8fc-494c-96e6-a2391186a6dd req-92f56990-4b30-49d0-8d22-a5f1e549fa56 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430465
May 20 16:23:53.673892 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Provisioning complete for port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:23:53.674257 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:53.797468 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6c4695-011c-4c49-96eb-115b4e59dc4f req-60811239-ee15-4e31-a012-2be0dd0728cd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:53.798905 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9b6c4695-011c-4c49-96eb-115b4e59dc4f req-60811239-ee15-4e31-a012-2be0dd0728cd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.0866032
May 20 16:23:53.929069 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9b6c4695-011c-4c49-96eb-115b4e59dc4f req-4d606ccd-0b64-4d8b-93f4-2c637dff4781 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1241624
May 20 16:23:54.499972 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2bdc66d-f906-400a-8956-fc46fa170950 req-7129aa8b-928f-4d81-91a2-689c130324dd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:54.501687 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2bdc66d-f906-400a-8956-fc46fa170950 req-7129aa8b-928f-4d81-91a2-689c130324dd tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.0869915
May 20 16:23:54.559101 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2bdc66d-f906-400a-8956-fc46fa170950 req-ce1fdea2-0e5f-4b1e-82f8-788c7e5a687b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0509682
May 20 16:23:56.057448 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-fe96ea61-3ebf-441c-aa3f-214f13f30dfb service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0779042
May 20 16:23:56.200329 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e556f962-570b-4c8f-83bf-375ff3d306df req-c73a780b-ffb2-42a6-b1b7-1c4bcf335ff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:56.201803 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-c73a780b-ffb2-42a6-b1b7-1c4bcf335ff3 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 1099 time: 0.0759261
May 20 16:23:56.352693 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e556f962-570b-4c8f-83bf-375ff3d306df req-7e2a53c1-28c0-4595-ae8d-588ba4e0c1f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:56.354288 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-7e2a53c1-28c0-4595-ae8d-588ba4e0c1f2 service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1329434
May 20 16:23:56.461844 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-9b732db2-71d6-4a9b-ab66-d66d19d82122 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 200  len: 1000 time: 0.1006076
May 20 16:23:56.525836 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e556f962-570b-4c8f-83bf-375ff3d306df req-2914662a-0695-4f48-b274-cd7d30b9ec86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:56.527327 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-2914662a-0695-4f48-b274-cd7d30b9ec86 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0584223
May 20 16:23:56.608477 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e556f962-570b-4c8f-83bf-375ff3d306df req-1031315a-1f67-480a-9531-f2abfff2b9fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:56.610104 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-1031315a-1f67-480a-9531-f2abfff2b9fd service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0755601
May 20 16:23:56.762592 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-67f4bcc6-339a-4c9c-b7d4-a3c2e291ff1b service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1456022
May 20 16:23:56.816308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b132e473-3862-4602-bd4e-f64a51b77d6f req-43f3dafb-f144-478b-9aa8-dd21e2e3a563 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:56.818742 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b132e473-3862-4602-bd4e-f64a51b77d6f req-43f3dafb-f144-478b-9aa8-dd21e2e3a563 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0928955
May 20 16:23:56.867588 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b132e473-3862-4602-bd4e-f64a51b77d6f req-8f2b8a9d-1c0a-4cc7-91cc-5115f4ab4656 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428026
May 20 16:23:56.916220 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-e556f962-570b-4c8f-83bf-375ff3d306df req-1a4c39e2-bcb9-47ac-973b-5ecaa74d625b service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1466866
May 20 16:23:58.063263 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab047724-937a-46db-86bd-df35774e0df3 req-d81d8987-5d69-4e56-9650-b3d12788f516 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:58.064700 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab047724-937a-46db-86bd-df35774e0df3 req-d81d8987-5d69-4e56-9650-b3d12788f516 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0859067
May 20 16:23:58.121495 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab047724-937a-46db-86bd-df35774e0df3 req-cc61c3d1-e0fe-43bc-8519-b0839793fc19 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0508888
May 20 16:23:59.310307 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8287923-7161-45d7-9100-db8f8b5952ec req-293395f6-8fb8-4247-9a40-c7cd8d35ca27 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:23:59.311824 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8287923-7161-45d7-9100-db8f8b5952ec req-293395f6-8fb8-4247-9a40-c7cd8d35ca27 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0828304
May 20 16:23:59.329142 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:23:59.371867 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8287923-7161-45d7-9100-db8f8b5952ec req-8fe0ee57-ab08-4d73-a801-9377d671859b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0504451
May 20 16:24:00.569141 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a90a63-c8cd-41eb-ad8d-431898f3b250 req-78fe315c-30e1-4ca1-aae4-8ea86b7acb97 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:00.570595 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03a90a63-c8cd-41eb-ad8d-431898f3b250 req-78fe315c-30e1-4ca1-aae4-8ea86b7acb97 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0836809
May 20 16:24:00.615424 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03a90a63-c8cd-41eb-ad8d-431898f3b250 req-0b191f9e-90e4-4f34-a115-a2a254575576 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389512
May 20 16:24:01.814394 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98ee6e2-ca1e-4a08-9d17-742c13c222b1 req-ef21a586-7828-44c9-bbde-7231a9a32333 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:01.815899 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b98ee6e2-ca1e-4a08-9d17-742c13c222b1 req-ef21a586-7828-44c9-bbde-7231a9a32333 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0820501
May 20 16:24:01.863497 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b98ee6e2-ca1e-4a08-9d17-742c13c222b1 req-5bce960f-72e5-454a-a392-bd64c28fe298 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416381
May 20 16:24:03.052514 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0695a3f-6321-4087-a85b-1d683ea5728f req-67ad5e0c-2c1a-45a4-9b10-d5e9da9d4db8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:03.054049 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e0695a3f-6321-4087-a85b-1d683ea5728f req-67ad5e0c-2c1a-45a4-9b10-d5e9da9d4db8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0823483
May 20 16:24:03.098539 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e0695a3f-6321-4087-a85b-1d683ea5728f req-fb340c92-97fe-4d59-bce7-7f8875a7ffbb tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387695
May 20 16:24:04.286907 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7105d9-878d-4bbd-9483-c26148ee7198 req-204f03b8-cd7e-4c4a-ac5f-c859e058fa61 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:04.288396 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6f7105d9-878d-4bbd-9483-c26148ee7198 req-204f03b8-cd7e-4c4a-ac5f-c859e058fa61 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0835934
May 20 16:24:04.332570 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6f7105d9-878d-4bbd-9483-c26148ee7198 req-04b1b34d-b228-41b8-b33a-96590a2083e6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383530
May 20 16:24:05.524615 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4974227-d530-4b8f-95df-59db7a45410d req-34326229-b90e-45f4-bbbe-bbeb0dd5187b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:05.526119 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4974227-d530-4b8f-95df-59db7a45410d req-34326229-b90e-45f4-bbbe-bbeb0dd5187b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0829978
May 20 16:24:05.571301 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d4974227-d530-4b8f-95df-59db7a45410d req-8044c083-1c1e-44e8-95a1-831e552c5653 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395033
May 20 16:24:06.763318 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c4d1422-f297-435d-a033-3bc080cdda63 req-6599cc6a-dad5-49d7-8dc1-6995d4e69ddd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:06.764930 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3c4d1422-f297-435d-a033-3bc080cdda63 req-6599cc6a-dad5-49d7-8dc1-6995d4e69ddd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0853329
May 20 16:24:06.811047 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3c4d1422-f297-435d-a033-3bc080cdda63 req-74773b00-6003-4f86-b4fe-adb2f5dc8723 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394926
May 20 16:24:08.003860 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2702e5f9-bf71-4d12-872d-a5ca94f6597f req-27af44b3-f732-44f9-94e1-ca29c50af2c7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:08.005636 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2702e5f9-bf71-4d12-872d-a5ca94f6597f req-27af44b3-f732-44f9-94e1-ca29c50af2c7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0817540
May 20 16:24:08.057735 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2702e5f9-bf71-4d12-872d-a5ca94f6597f req-e376f99f-9c43-49d9-87fd-72d738cf8caa tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0465388
May 20 16:24:08.455123 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6ae3a62-ad33-4946-ba2d-d955935c5c1c req-fb86b343-fe6b-4abb-a598-30eec7798fde tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:08.456693 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e6ae3a62-ad33-4946-ba2d-d955935c5c1c req-fb86b343-fe6b-4abb-a598-30eec7798fde tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.0823061
May 20 16:24:08.504099 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e6ae3a62-ad33-4946-ba2d-d955935c5c1c req-325cfe07-592b-4e7e-8a5e-d31815cff69b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402555
May 20 16:24:08.527971 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37332) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:08.837499 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02c54108-f886-4bd1-987f-fc189e931ef3 tempest-TestMinimumBasicScenario-1414773650 tempest-TestMinimumBasicScenario-1414773650-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:08.838997 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-02c54108-f886-4bd1-987f-fc189e931ef3 tempest-TestMinimumBasicScenario-1414773650 tempest-TestMinimumBasicScenario-1414773650-project-admin] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1094 time: 0.3100092
May 20 16:24:08.841955 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37342) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:08.846953 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'port_id': '16ee028f-977c-4c03-a101-a688c6953d30', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'fixed_ip_address': '172.20.0.13'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:08.852933 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:08.856790 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:floatingip and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:08.859927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:08.866193 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:08.970496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for floatingip, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:09.112039 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:09.253622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0ecb64-a74b-425a-9abf-85a81e7c7c02 req-f53a2d42-2f4c-41c5-b5c5-d84c0e824530 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:09.255298 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a0ecb64-a74b-425a-9abf-85a81e7c7c02 req-f53a2d42-2f4c-41c5-b5c5-d84c0e824530 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0854938
May 20 16:24:09.265285 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Allocated IP 172.27.0.166 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/53980d5a-088a-4af2-a668-227a5ba9a412) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:24:09.301530 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a0ecb64-a74b-425a-9abf-85a81e7c7c02 req-c8d82c78-fe65-4555-9fc2-49d447d02ca4 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403225
May 20 16:24:09.414604 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:09.575996 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:09.580829 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a86b2ffe-18f4-45f7-9547-a8c5186714e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:09.644590 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:24:09.647544 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:24:09.651139 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:24:09.687213 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'Port': ['ID=53980d5a-088a-4af2-a668-227a5ba9a412,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:09.695134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:10.206831 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:10.427285 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:10.522937 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b33f71-a549-452c-b273-40793e48e6f6 req-e181848e-66d0-4dc2-8744-7189222893b1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:10.524445 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-59b33f71-a549-452c-b273-40793e48e6f6 req-e181848e-66d0-4dc2-8744-7189222893b1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1458950
May 20 16:24:10.537190 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf640cd-75c8-4f87-8984-981a5bf9019d req-eb45261b-7640-4da1-86b4-e5b2a1cf8f1f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:10.538620 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bcf640cd-75c8-4f87-8984-981a5bf9019d req-eb45261b-7640-4da1-86b4-e5b2a1cf8f1f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1168664
May 20 16:24:10.608853 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-59b33f71-a549-452c-b273-40793e48e6f6 req-ba1a98de-c3b0-4bf9-b12c-ea2f3f8a0ea2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0690033
May 20 16:24:10.619928 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bcf640cd-75c8-4f87-8984-981a5bf9019d req-bb426b84-66ee-4c8a-b208-421ca5cf726f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0659902
May 20 16:24:10.712263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:10.790538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:10.794221 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-54d5c1b8-b41b-4b56-8834-f4024aa4b2e8 tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:10.897829 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'Port': ['ID=53980d5a-088a-4af2-a668-227a5ba9a412,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:10.901772 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:10.908333 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:11.073501 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Floating IP 3fc22b9e-088c-47fe-823b-0597ad6069f6 associated. External IP: 172.27.0.166, port: 16ee028f-977c-4c03-a101-a688c6953d30.
May 20 16:24:11.421339 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Router 611172fd-bcae-4d71-9f24-054476247eea has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:24:11.595340 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:24:11.605103 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] Sync routers for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:24:11.615847 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:11.616471 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712595640>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:11.702215 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:11.766088 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.9231019
May 20 16:24:11.766749 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:11.771687 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37368) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:11.777114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1358111619', 'description': 'tempest-secgroup-smoke-1358111619 description', 'project_id': '8614158322ae423bb16b1c0645c66cf9'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:11.783658 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:11.788242 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:11.792262 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:11.798500 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:11.814135 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:11.881614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3581b507-c415-4328-8bf8-fd9541756add req-1b69bc5c-d5d4-425a-acfb-38a82add4f08 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:11.883106 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3581b507-c415-4328-8bf8-fd9541756add req-1b69bc5c-d5d4-425a-acfb-38a82add4f08 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1156690
May 20 16:24:11.892542 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f95498f-f394-4bb9-b168-0f3e4fab64df req-a1013853-974f-4e1c-be67-abb24ce8a120 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:11.895759 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7f95498f-f394-4bb9-b168-0f3e4fab64df req-a1013853-974f-4e1c-be67-abb24ce8a120 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1653557
May 20 16:24:11.947227 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:11.972484 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:11.976716 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:11.979862 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:11.986518 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:12.067637 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3581b507-c415-4328-8bf8-fd9541756add req-8ecf44eb-67eb-4ef3-b90c-4ddddce7fcd2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1707017
May 20 16:24:12.069711 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:12.073346 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7f95498f-f394-4bb9-b168-0f3e4fab64df req-fc25b0ea-c213-45d2-9dac-aaece6bf5fce tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1632419
May 20 16:24:12.146595 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30', 'status': 'completed', 'code': 200}
May 20 16:24:12.200044 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712595640>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '3fc22b9e-088c-47fe-823b-0597ad6069f6', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'floating_ip_address': '172.27.0.166', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '611172fd-bcae-4d71-9f24-054476247eea', 'port_id': '16ee028f-977c-4c03-a101-a688c6953d30', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'mac_address': 'fa:16:3e:d0:d2:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:10Z', 'updated_at': '2021-05-20T16:24:10Z', 'revision_number': 0, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:59Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:12.204065 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] Checking router: 611172fd-bcae-4d71-9f24-054476247eea for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:24:12.213007 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:12.213615 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712595640>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:12.229916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:12.239893 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-77b44c2b-4b76-4793-9a7d-4d81da847fca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:12.293739 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a292603c-6418-4b1e-bfa7-3426b368cc59,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:12.296630 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:12.316759 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-f1ddfa29-63e0-47fc-a52e-75851827933f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:12.318376 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-f1ddfa29-63e0-47fc-a52e-75851827933f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1099 time: 0.1237795
May 20 16:24:12.418931 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:12.420150 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.6471782
May 20 16:24:12.423128 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37376) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:12.432406 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:12.439603 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'security_group_rule': {'security_group_id': 'a292603c-6418-4b1e-bfa7-3426b368cc59', 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:12.456339 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:12.460987 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:12.464134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-65f051cd-fb0b-43fb-a15e-aa676a4edb3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:12.465815 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-65f051cd-fb0b-43fb-a15e-aa676a4edb3b service neutron] 10.222.0.16 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 916 time: 0.1333983
May 20 16:24:12.470268 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:12.476986 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:12.569766 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-d74e5441-6a27-4679-a575-927c8d6c35c5 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 1000 time: 0.0972605
May 20 16:24:12.579329 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:12.649887 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:12.744707 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-765fefca-5146-4eda-b9a3-1f1cac7a2e5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:12.746397 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-765fefca-5146-4eda-b9a3-1f1cac7a2e5e service neutron] 10.222.0.16 "GET /v2.0/subnets?id=227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 200  len: 854 time: 0.1699374
May 20 16:24:12.795174 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712595640>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '3fc22b9e-088c-47fe-823b-0597ad6069f6', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'floating_ip_address': '172.27.0.166', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '611172fd-bcae-4d71-9f24-054476247eea', 'port_id': '16ee028f-977c-4c03-a101-a688c6953d30', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'mac_address': 'fa:16:3e:d0:d2:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:10Z', 'updated_at': '2021-05-20T16:24:10Z', 'revision_number': 0, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:59Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:12.799120 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48f9b416-0cac-4f9b-9743-a44cc80fe6ab None None] The sync data for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi is: [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '3fc22b9e-088c-47fe-823b-0597ad6069f6', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'floating_ip_address': '172.27.0.166', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '611172fd-bcae-4d71-9f24-054476247eea', 'port_id': '16ee028f-977c-4c03-a101-a688c6953d30', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'mac_address': 'fa:16:3e:d0:d2:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:10Z', 'updated_at': '2021-05-20T16:24:10Z', 'revision_number': 0, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:59Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:24:12.827535 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:12.830638 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-799fca9b-e556-4a7d-b017-870b707e910a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:12.832270 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-799fca9b-e556-4a7d-b017-870b707e910a service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1c714e06-ccca-4a05-8bd6-477318017820&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0702937
May 20 16:24:12.839742 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:12.854712 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e94c124a-452e-42db-bdaf-790dcb19e245,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:12.865883 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.866261 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.866627 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.866991 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.867384 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.867744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.868097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.868451 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.868798 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.869143 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.869493 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.869844 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:12.873440 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:12.980479 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-5b526686-1a02-43b6-9770-424ea374e0cf service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1356778
May 20 16:24:12.996949 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77805d3c-8afe-4231-8029-4ad8bf71c145 None None] New status for floating IP 3fc22b9e-088c-47fe-823b-0597ad6069f6: ACTIVE {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:24:13.039367 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:13.043326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-aaeb887d-74d4-403b-8163-21904b867548 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.6164048
May 20 16:24:13.043548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37380) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:13.049860 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'security_group_rule': {'security_group_id': 'a292603c-6418-4b1e-bfa7-3426b368cc59', 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:13.063560 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:13.069231 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:13.073258 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:13.082490 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:13.119049 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-358e2bba-0125-40e7-82df-3d9cd1a2bacc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:13.121311 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-358e2bba-0125-40e7-82df-3d9cd1a2bacc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.1432197
May 20 16:24:13.121918 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-1c82879a-e2b6-44fe-b359-0f42a3b4be29 req-0b68166f-c820-4601-ab29-92967fdebd7b service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1341987
May 20 16:24:13.313481 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:13.483863 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:13.507715 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1fb726-4983-4ecf-bf07-77e9b7842e2f req-bc4b6dde-9726-45dc-8aa8-6039e79cb214 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:13.509189 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1e1fb726-4983-4ecf-bf07-77e9b7842e2f req-bc4b6dde-9726-45dc-8aa8-6039e79cb214 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.2903838
May 20 16:24:13.524899 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b987f47-c3ff-4f29-9a8b-dab80a294e42 req-b55e4bb1-aecf-4a77-97c9-94cb8fc1ca37 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:13.525907 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b987f47-c3ff-4f29-9a8b-dab80a294e42 req-b55e4bb1-aecf-4a77-97c9-94cb8fc1ca37 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 946 time: 0.2906981
May 20 16:24:13.557001 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Deleting port 4c1d2c1d-f53f-4921-822b-db24d856090e {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:24:13.557348 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:13.675986 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:13.694280 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:13.702319 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1e1fb726-4983-4ecf-bf07-77e9b7842e2f req-89730bad-7d3b-4844-b070-d1f4bce696ea tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1869848
May 20 16:24:13.704886 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b987f47-c3ff-4f29-9a8b-dab80a294e42 req-261a4ab9-c958-4bdc-accf-5326c172654e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=7940f732-e859-47f1-9869-53f257121fca&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1632524
May 20 16:24:13.730199 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=34642a8c-e7c2-45f3-b446-9196b63ad0b1,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:13.735351 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:13.763330 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] For port 4c1d2c1d-f53f-4921-822b-db24d856090e, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=4c1d2c1d-f53f-4921-822b-db24d856090e,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:13.763687 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:13.917098 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:13.918292 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-38463089-a934-42cc-b9f8-1950ad52e2cb tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.8738065
May 20 16:24:13.921399 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37390) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:13.927177 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'security_group_rule': {'security_group_id': 'a292603c-6418-4b1e-bfa7-3426b368cc59', 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:13.933105 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:13.937027 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:13.939934 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:13.947090 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:14.062390 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.062989 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.063096 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Floating IP 83b2ed64-36e8-479f-b5f3-2377b5deada1 disassociated. External IP: 172.27.0.28, port: 4c1d2c1d-f53f-4921-822b-db24d856090e.
May 20 16:24:14.063639 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Calling delete_port for 4c1d2c1d-f53f-4921-822b-db24d856090e owned by compute:nova {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:24:14.193760 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.261851 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.317118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.323334 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1fcac012-69dc-4c9b-83ac-ec116ea52a21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:14.373505 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event deleted for resources: {'Port': ['ID=4c1d2c1d-f53f-4921-822b-db24d856090e,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:14.376744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:14.449921 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.452721 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-30f636c7-5f6c-405c-a6e6-0b6887e8789a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:14.477278 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e90d5c0-5150-4ec7-9ef1-03b45aafb462,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:14.488211 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:14.562508 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Router 7ca2542d-958b-4848-b460-42f1d2b2dd11 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:24:14.676639 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.677994 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-fc48d12e-883e-4a34-b32c-706b9bccdc9a tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.7555659
May 20 16:24:14.680717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37396) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:14.690400 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'security_group_rule': {'security_group_id': 'a292603c-6418-4b1e-bfa7-3426b368cc59', 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:14.691927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:14.695712 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:14.698652 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:14.704788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:14.884814 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.933355 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fff0e1c6-3ce1-410f-8fdb-54d23726d8f5 req-d38ee2b1-fef9-4011-9621-8fe2d613097d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.0907290
May 20 16:24:14.952826 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:24:14.953476 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:14.963804 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] Sync routers for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:24:14.972777 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:14.973462 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711da2f40>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:15.035791 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] No DVR routers for this DVR port 4c1d2c1d-f53f-4921-822b-db24d856090e on host hv-cinder-68948 {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:24:15.039336 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:15.041910 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-deleted', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:15.053107 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f1cafa10-1368-4205-8f12-fed7d9d745d1 req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "DELETE /v2.0/ports/4c1d2c1d-f53f-4921-822b-db24d856090e HTTP/1.1" status: 204  len: 173 time: 1.8995132
May 20 16:24:15.061596 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d01dfa98-61e7-4563-ac9c-35c6918ebfa4 req-122d4ca0-9461-42d6-9f49-fdca8c615d7d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:15.062201 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:15.063081 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d01dfa98-61e7-4563-ac9c-35c6918ebfa4 req-122d4ca0-9461-42d6-9f49-fdca8c615d7d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.2316835
May 20 16:24:15.066964 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-59b73206-3ab6-447e-a904-8daa3cf26ced tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:15.083972 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2fc05114-582e-4f36-b4cc-6ccde9ce23a6,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:15.088404 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:15.120456 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6bdb3682-b415-4d8d-ba0d-35ad73dd9e89', 'name': 'network-vif-deleted', 'tag': '4c1d2c1d-f53f-4921-822b-db24d856090e', 'status': 'completed', 'code': 200}
May 20 16:24:15.123680 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d01dfa98-61e7-4563-ac9c-35c6918ebfa4 req-4eba5a71-534b-4eaa-8567-53286b9427c2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0513265
May 20 16:24:15.170010 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:15.175765 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:15.177249 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-c8f680ee-d109-409d-a94b-96aaee4a92e0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4956193
May 20 16:24:15.180241 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37406) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:15.185539 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'security_group_rule': {'security_group_id': 'a292603c-6418-4b1e-bfa7-3426b368cc59', 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:15.192084 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:15.196037 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:15.199088 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:15.205560 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:15.295755 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.securitygroups_db [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Project 8614158322ae423bb16b1c0645c66cf9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 16:24:15.304447 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:15.385842 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:15.513262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:15.522059 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-b81f1edd-484d-4388-8cf9-1c65815f4923 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:15.559290 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b85f02f1-46a8-415c-936b-c0281cfe971f,revision_number=0']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:15.562358 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:15.595554 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711da2f40>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:15.649288 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] Checking router: 7ca2542d-958b-4848-b460-42f1d2b2dd11 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:24:15.669662 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:15.670287 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711da2f40>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:23:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:15.719164 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:15.724124 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37412) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:15.724610 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-85be0768-6f85-4f00-a7a6-6b78dd67693d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.5431948
May 20 16:24:15.730354 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'security_group_rule': {'security_group_id': 'a292603c-6418-4b1e-bfa7-3426b368cc59', 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:15.738310 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:15.742544 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Usage tracker for resource:security_group_rule and tenant:8614158322ae423bb16b1c0645c66cf9 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:15.745967 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:15.753198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:15.952979 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:15.956228 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.securitygroups_db [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Project 8614158322ae423bb16b1c0645c66cf9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 16:24:15.961078 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:16.049370 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:16.091398 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b2e0bed3-35bb-4cab-a7ab-d810692c31af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:16.127556 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-4d7d3f96-23cb-4634-b090-0ff2f0b09687 req-1e27572c-ff0c-4d3f-8f56-3b6cabf7e8ad tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Synchronizing usage tracker for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:24:16.185254 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:16.187753 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:16.188028 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:24:16.211603 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e02c73d-1568-4fa6-84e8-0211c6710b58,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:16.223058 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:16.225454 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-4d7d3f96-23cb-4634-b090-0ff2f0b09687 req-1e27572c-ff0c-4d3f-8f56-3b6cabf7e8ad tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Unset dirty status for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:24:16.226681 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4d7d3f96-23cb-4634-b090-0ff2f0b09687 req-1e27572c-ff0c-4d3f-8f56-3b6cabf7e8ad tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=6bdb3682-b415-4d8d-ba0d-35ad73dd9e89 HTTP/1.1" status: 200  len: 210 time: 0.1478558
May 20 16:24:16.231681 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 4c1d2c1d-f53f-4921-822b-db24d856090e {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:24:16.232144 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 4c1d2c1d-f53f-4921-822b-db24d856090e not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:24:16.340858 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa4253ca-695f-4bf8-afe5-befa4ce6d5b4 req-4b491dab-3767-4f87-84e9-a2b6592788de tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:16.342377 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fa4253ca-695f-4bf8-afe5-befa4ce6d5b4 req-4b491dab-3767-4f87-84e9-a2b6592788de tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0843587
May 20 16:24:16.345063 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711da2f40>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:16.351567 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a8d777c-52b6-4af0-bcde-80495ea40ae3 None None] The sync data for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi is: [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:24:16.393209 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fa4253ca-695f-4bf8-afe5-befa4ce6d5b4 req-3cae824d-82f8-4e45-8196-81718f81998b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434287
May 20 16:24:16.423577 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:16.423577 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.6864884
May 20 16:24:16.562894 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dd005acc-de2c-4372-9822-aa74531151dd req-ee62652d-2c4f-454b-8ada-147e6cccca58 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1358111619&fields=id&tenant_id=8614158322ae423bb16b1c0645c66cf9 HTTP/1.1" status: 200  len: 267 time: 0.0555038
May 20 16:24:16.596205 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-779b02b3-4900-42cf-975b-78ef42e7b2de None None] New status for floating IP 83b2ed64-36e8-479f-b5f3-2377b5deada1: DOWN {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:24:16.652128 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd005acc-de2c-4372-9822-aa74531151dd req-7abeaab1-f09f-4ea2-85b9-b73c5a70e9ee tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:16.653776 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dd005acc-de2c-4372-9822-aa74531151dd req-7abeaab1-f09f-4ea2-85b9-b73c5a70e9ee tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.0842254
May 20 16:24:16.666352 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'port': {'security_groups': ['62841583-ef69-4bd6-9ba1-a6118731c4d9', 'a292603c-6418-4b1e-bfa7-3426b368cc59']}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:16.811149 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.094798 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=16ee028f-977c-4c03-a101-a688c6953d30,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:17.129210 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.295681 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.306940 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:17.312642 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['16ee028f-977c-4c03-a101-a688c6953d30'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:24:17.389191 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:17.389191 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.403686 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dd005acc-de2c-4372-9822-aa74531151dd req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "PUT /v2.0/ports/16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 982 time: 0.7349460
May 20 16:24:17.404561 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:17.414443 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=6']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:17.417782 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-89dcf487-d958-4eaf-937c-4abe4140ce4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:17.480678 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['16ee028f-977c-4c03-a101-a688c6953d30'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:24:17.529879 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37434) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:17.593126 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30', 'status': 'completed', 'code': 200}
May 20 16:24:17.634794 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecd357f-a4bc-4f9c-89d3-05e8ea4d4bee req-e9d1a507-9238-4d7c-80d5-75751e89de16 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:17.636485 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8ecd357f-a4bc-4f9c-89d3-05e8ea4d4bee req-e9d1a507-9238-4d7c-80d5-75751e89de16 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.1419947
May 20 16:24:17.643167 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.680174 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.820037 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8ecd357f-a4bc-4f9c-89d3-05e8ea4d4bee req-50fe8b3f-940b-4151-be03-71ae79110e7e tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1238236
May 20 16:24:17.820260 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-64ef15b9-5fa5-4ecf-8e2b-0aa8212b327e None None] Provisioning complete for port 16ee028f-977c-4c03-a101-a688c6953d30 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:24:17.820645 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-64ef15b9-5fa5-4ecf-8e2b-0aa8212b327e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.845382 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-c4f6f4f0-3397-42c6-89c2-176894945280 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:17.847280 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-c4f6f4f0-3397-42c6-89c2-176894945280 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1138 time: 0.2098279
May 20 16:24:17.889723 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e62877-b553-4fd3-bff6-9968d301501f req-45fe7250-0d01-4b15-b89e-ff41824f92d8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:17.891130 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:17.891316 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8e62877-b553-4fd3-bff6-9968d301501f req-45fe7250-0d01-4b15-b89e-ff41824f92d8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1779938
May 20 16:24:17.896995 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-469f894c-b15d-4188-ac2b-284c0cd8f180 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:17.922530 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7940f732-e859-47f1-9869-53f257121fca,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:17.925754 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:18.013679 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8e62877-b553-4fd3-bff6-9968d301501f req-f763621c-d2a2-4ba5-85bd-d7660dc73cde tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1120234
May 20 16:24:18.044736 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-2c467840-bdbe-47eb-b92e-3756b0f53665 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:18.046507 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-2c467840-bdbe-47eb-b92e-3756b0f53665 service neutron] 10.222.0.16 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 916 time: 0.1910417
May 20 16:24:18.103096 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:18.107542 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "DELETE /v2.0/security-groups/7940f732-e859-47f1-9869-53f257121fca HTTP/1.1" status: 204  len: 168 time: 0.5741484
May 20 16:24:18.108316 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37444) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:18.133305 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.api.v2.resource [None req-ff491530-d415-44b0-9aea-4a761dd14249 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] show failed (client error): The resource could not be found.
May 20 16:24:18.142073 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ff491530-d415-44b0-9aea-4a761dd14249 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups/7940f732-e859-47f1-9869-53f257121fca HTTP/1.1" status: 404  len: 347 time: 0.0229225
May 20 16:24:18.142717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37448) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:18.180629 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-81369538-6594-4a2e-a6e7-f1e2b3f5b146 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 1002 time: 0.1261511
May 20 16:24:18.348745 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-d1873e11-f7bb-48af-9fea-5350ddec328a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:18.350460 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-d1873e11-f7bb-48af-9fea-5350ddec328a service neutron] 10.222.0.16 "GET /v2.0/subnets?id=227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 200  len: 854 time: 0.1614451
May 20 16:24:18.397480 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Deleting port 4ecfeabb-5dfb-4697-ace2-8e5deb9243f4 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:24:18.397822 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:18.430778 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-638a2893-2716-487f-a828-e8dda9f6acdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:18.435769 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-638a2893-2716-487f-a828-e8dda9f6acdd service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1c714e06-ccca-4a05-8bd6-477318017820&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0753253
May 20 16:24:18.489528 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:18.526189 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:18.526514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:18.637776 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-08c71108-5be0-4110-96fa-004fca2af999 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1907337
May 20 16:24:18.652362 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Calling delete_port for 4ecfeabb-5dfb-4697-ace2-8e5deb9243f4 owned by network:floatingip {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:24:18.674309 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f4997895-a8eb-47e6-90eb-889f9801ce85 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:18.680786 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9156dc61-d31e-4e27-85a9-6de2f03394cb req-48120cd4-0765-43b8-b8cc-7fff63263efe tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:18.683643 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9156dc61-d31e-4e27-85a9-6de2f03394cb req-48120cd4-0765-43b8-b8cc-7fff63263efe tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1501489
May 20 16:24:18.805176 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9156dc61-d31e-4e27-85a9-6de2f03394cb req-38b5d290-ff5b-441c-9de4-04f7cff88f57 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1173947
May 20 16:24:18.829079 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-39626ccf-6140-4643-b16e-3d610689559a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:18.830276 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7b61b4c9-53e7-4aae-b66b-8b6f9e77be59 req-678afb89-438f-4927-8b18-9cc9ee8ab637 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1789637
May 20 16:24:18.830551 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-39626ccf-6140-4643-b16e-3d610689559a service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1098 time: 0.1224272
May 20 16:24:18.935909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:18.942250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:18.964560 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:24:19.081794 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event deleted for resources: {'Port': ['ID=4ecfeabb-5dfb-4697-ace2-8e5deb9243f4,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:19.087508 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:19.179878 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-1598f56c-5e4d-467a-91b8-b74c2efd6f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:19.180660 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-1598f56c-5e4d-467a-91b8-b74c2efd6f2a service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.3380361
May 20 16:24:19.264734 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:19.298782 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-b0303a3e-9e6b-4a3a-9d69-be3190df6f7f service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 1001 time: 0.1113555
May 20 16:24:19.362741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:19.363878 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "DELETE /v2.0/floatingips/83b2ed64-36e8-479f-b5f3-2377b5deada1 HTTP/1.1" status: 204  len: 168 time: 1.2200868
May 20 16:24:19.373406 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-911c95ad-1fd5-4e5e-b1ef-8f2651164b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:19.374838 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-911c95ad-1fd5-4e5e-b1ef-8f2651164b46 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.0691862
May 20 16:24:19.463124 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-a886314e-f836-40f7-a433-986597358bb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:19.463124 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-a886314e-f836-40f7-a433-986597358bb1 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0780358
May 20 16:24:19.605946 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-808ea15f-21a9-422d-acff-376ad7095d69 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1332889
May 20 16:24:19.641805 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:19.740730 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-a555d9b5-e8c0-42c9-9588-4d4762385663 req-22b23116-fdd7-4a14-a94c-3df9f9bb5674 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1275706
May 20 16:24:19.828010 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37458) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:19.835892 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1479187941', 'description': 'tempest-description--94966949'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:19.846961 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:19.854050 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:19.859291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:19.870221 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:19.956311 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:19.976663 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:19.981244 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group_rule and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:19.984457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:19.993042 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:20.026696 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1262e2e4-c4c6-4113-a855-b20e2e6b8105 req-af31ddcc-5c8c-4d31-8303-f2cc0b9184d0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:20.028923 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1262e2e4-c4c6-4113-a855-b20e2e6b8105 req-af31ddcc-5c8c-4d31-8303-f2cc0b9184d0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0919034
May 20 16:24:20.078952 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.079909 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1262e2e4-c4c6-4113-a855-b20e2e6b8105 req-19179034-4da4-4889-b8df-4b41aab7c7d8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437069
May 20 16:24:20.146632 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.150611 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5caa7989-c6b5-4356-b315-bca95d8cde40 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:20.196489 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b44e7715-c706-45ed-ab9e-1a903e12abd0,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:20.199598 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:20.290007 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.294051 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.4621623
May 20 16:24:20.294211 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37474) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:20.299682 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'security_group_rule': {'security_group_id': 'b44e7715-c706-45ed-ab9e-1a903e12abd0', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:20.306295 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:20.310196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group_rule and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:20.313115 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:20.318947 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:20.346165 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-5f2dbbe0-a400-4b86-ae51-c80eac1d9b48 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:security_group {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:24:20.444479 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.470186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-5f2dbbe0-a400-4b86-ae51-c80eac1d9b48 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:security_group {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:24:20.471454 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-5f2dbbe0-a400-4b86-ae51-c80eac1d9b48 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-193855468&fields=id&tenant_id=a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 267 time: 0.1647706
May 20 16:24:20.508579 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.624439 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-f4231f04-5039-475f-b1d5-8c8a173f766c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:20.625098 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-f4231f04-5039-475f-b1d5-8c8a173f766c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:network {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:24:20.638602 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.640787 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4260feea-f015-490e-b74f-407c28c33a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:20.663670 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b0e597d7-b481-4679-af7f-df8095b832bb,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:20.669065 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:20.752334 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-f4231f04-5039-475f-b1d5-8c8a173f766c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:network {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:24:20.753539 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-f4231f04-5039-475f-b1d5-8c8a173f766c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 812 time: 0.2742994
May 20 16:24:20.770066 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-1c781b95-3ca8-4c9a-ab43-a4ff365dc6ff tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/quotas/a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 375 time: 0.0093558
May 20 16:24:20.786829 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.788155 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a06d479d-3886-44d1-8381-ee150a1a7f5a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4929714
May 20 16:24:20.790906 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37478) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:20.796085 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'security_group_rule': {'security_group_id': 'b44e7715-c706-45ed-ab9e-1a903e12abd0', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:20.802033 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:20.807845 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:security_group_rule and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:20.808861 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:20.814650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:20.857659 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-6a723a29-a44f-406e-bcbe-9a9c0ba9ffa5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0835366
May 20 16:24:20.889522 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.952936 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:20.997958 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-65cde3c0-e938-42d6-b081-a6777a499ffd service neutron] 10.222.0.64 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1287653
May 20 16:24:21.067287 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:21.073414 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:21.093321 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1db7d9ff-3c56-4741-91a1-603a12a56825,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:21.095821 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:21.135982 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-9699afeb-0ef7-488a-86d3-fe57bfc7722f service neutron] 10.222.0.64 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1316018
May 20 16:24:21.170652 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:21.175044 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-69ba2e99-ba94-4054-985a-7626c8a7ccf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3801765
May 20 16:24:21.175586 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37484) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:21.181843 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:21.192647 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:21.197469 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:floatingip and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:21.202616 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:21.210949 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:21.278869 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcda48c-7ec5-40b6-b3e7-2871a6079331 req-fd34b18f-4317-467d-bd03-c35c21a3a48d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:21.280415 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4dcda48c-7ec5-40b6-b3e7-2871a6079331 req-fd34b18f-4317-467d-bd03-c35c21a3a48d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0846326
May 20 16:24:21.327065 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4dcda48c-7ec5-40b6-b3e7-2871a6079331 req-e6bf4d68-23c5-4e91-b87b-6c4e1e9d62cf tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410295
May 20 16:24:21.341087 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:21.369741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:21.504705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:21.641605 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Allocated IP 172.27.0.66 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/7c457a03-db12-4579-b231-6be6d9b4e358) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:24:21.785048 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:21.899577 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:21.904659 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:21.930622 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-155eb09c-d102-474b-ac8a-21f7dec6d18f req-2d00a662-1cce-4ff3-a624-4b4b38cc6eea tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 210 time: 0.0468891
May 20 16:24:21.972937 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:24:21.975222 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:24:21.979023 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:24:22.016044 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'Port': ['ID=7c457a03-db12-4579-b231-6be6d9b4e358,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:22.023787 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:22.063543 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:22.217161 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:22.513312 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:22.575454 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:22.580263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:22.683735 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'Port': ['ID=7c457a03-db12-4579-b231-6be6d9b4e358,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:22.687791 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:22.696875 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:22.824717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:22.858872 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.6494431
May 20 16:24:23.042133 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ad328ee4-203a-49ee-91a8-7d76e4d2adb4 req-3c2e6a47-4a5c-4d2b-8c4a-89818f35cf91 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 210 time: 0.0593512
May 20 16:24:23.069766 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-09bcea29-2219-4b9f-bdda-81cf8040423f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-securitygroup--1479187941&fields=id&tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 267 time: 0.0521545
May 20 16:24:23.221344 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-0654ffb2-a55d-4952-a6b0-fbc9a31e393c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:23.223413 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-0654ffb2-a55d-4952-a6b0-fbc9a31e393c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 817 time: 0.1467564
May 20 16:24:23.239104 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-55342887-c5e5-45c5-b771-c8ed41b4f99b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/quotas/ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 375 time: 0.0101125
May 20 16:24:23.414663 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-06a8ea87-129f-44fb-9bfb-e52387e42640 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1699688
May 20 16:24:23.552685 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-a32bee39-d66b-4b4f-b5b8-f829d7d83196 service neutron] 10.222.0.64 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1257968
May 20 16:24:23.684571 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1c89851a-9e30-47a8-ac1d-72b8d1843c82 service neutron] 10.222.0.64 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1260035
May 20 16:24:23.948705 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4482639e-bc70-4ca5-9492-12125148b070 req-921c5113-455c-463b-b984-456b2449bf79 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 210 time: 0.0426309
May 20 16:24:24.194303 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6adaeaa2-8dc3-4e50-b18d-fb4efe5c7f41 req-4d253359-3003-42e9-96f6-0768deb018fa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 210 time: 0.0474608
May 20 16:24:24.478539 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-a9b7ed46-228d-45da-b2bd-810ea0544d54 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:24.479906 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-a9b7ed46-228d-45da-b2bd-810ea0544d54 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 812 time: 0.1453812
May 20 16:24:24.528738 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-d2b64d17-190e-466d-90db-0746857815ec tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:security_group {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:24:24.541059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-d2b64d17-190e-466d-90db-0746857815ec tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:security_group {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:24:24.542164 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-d2b64d17-190e-466d-90db-0746857815ec tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 379 time: 0.0532804
May 20 16:24:24.551420 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'port': {'device_id': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'admin_state_up': True, 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'security_groups': ['da77fa6e-aadb-4acb-8e30-527bbdccd591']}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:24.687581 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:24.698318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:port and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:24.698318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:24.700637 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:24.809802 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Made reservation on behalf of a6bd88ff65e9420a8ccb36968532c4f6 for: {'port': 1} {{(pid=92422) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:24:24.814218 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:24.980024 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Allocated IP 172.20.0.11 (a02876f9-a796-4512-9044-eb08bb5d54c6/cb578eb9-d6e8-4e33-8d08-43894fe771d7/6fcb7112-8b10-4db0-8244-62d90add9bad) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:24:25.103515 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aed921e3-fe14-44bf-9338-df5842a6bd8c req-b8d5c8a4-43e6-4440-a716-38256a804166 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 210 time: 0.0439744
May 20 16:24:25.177169 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:25.192994 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Transition to ACTIVE for port object 6fcb7112-8b10-4db0-8244-62d90add9bad will not be triggered until provisioned by entity DHCP. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:24:25.299448 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:25.305550 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:25.375921 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Network a02876f9-a796-4512-9044-eb08bb5d54c6 is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:24:25.379210 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:24:25.383349 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:24:25.399952 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b69ea8-97e7-48a7-8902-c5cc6d86fca5 req-036b5e3e-c47f-45c9-984d-7826ad015057 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:25.401528 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b8b69ea8-97e7-48a7-8902-c5cc6d86fca5 req-036b5e3e-c47f-45c9-984d-7826ad015057 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 932 time: 0.0918808
May 20 16:24:25.422134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=6fcb7112-8b10-4db0-8244-62d90add9bad,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:25.429718 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:25.450134 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b8b69ea8-97e7-48a7-8902-c5cc6d86fca5 req-6d0c9897-4d99-47ed-a305-2574f59be40d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418556
May 20 16:24:25.470234 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:25.470234 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:25.616218 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-fbf97e31-4e60-4f8c-a496-3fef76888443 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0689862
May 20 16:24:25.633995 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Request body: {'port': {'device_id': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:25.715744 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-45d618fe-3b4a-4d53-849a-215c8fc0d09e None None] Provisioning for port 6fcb7112-8b10-4db0-8244-62d90add9bad completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:24:25.721830 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-45d618fe-3b4a-4d53-849a-215c8fc0d09e None None] Provisioning complete for port 6fcb7112-8b10-4db0-8244-62d90add9bad triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:24:25.733676 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-45d618fe-3b4a-4d53-849a-215c8fc0d09e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:25.746481 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:25.781025 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-45d618fe-3b4a-4d53-849a-215c8fc0d09e None None] Port 6fcb7112-8b10-4db0-8244-62d90add9bad cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:24:26.101108 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6fcb7112-8b10-4db0-8244-62d90add9bad {{(pid=92422) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:24:26.108759 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:26.123653 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.provisioning_blocks [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Transition to ACTIVE for port object 6fcb7112-8b10-4db0-8244-62d90add9bad will not be triggered until provisioned by entity L2. {{(pid=92422) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:24:26.187284 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-075cf3df-c7e6-431a-9d72-327ec38707d8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:26.188704 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-075cf3df-c7e6-431a-9d72-327ec38707d8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 817 time: 0.1709411
May 20 16:24:26.270648 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:26.271606 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8228dc50-6b3f-46c9-bfad-e80fcedb2e3f req-398d73e2-1ae3-4bab-be93-41bed3fbed4f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 210 time: 0.0540664
May 20 16:24:26.275710 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7db77121-4798-4ccb-9bd9-7e3920edde15 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:26.281190 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-98715d80-2d3f-42a6-86b0-60258ceaf6cc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 380 time: 0.0838921
May 20 16:24:26.290755 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'port': {'device_id': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'admin_state_up': True, 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'security_groups': ['b44e7715-c706-45ed-ab9e-1a903e12abd0']}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:26.451231 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Pushing event updated for resources: {'Port': ['ID=6fcb7112-8b10-4db0-8244-62d90add9bad,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:26.458630 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:26.463244 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Usage tracker for resource:port and tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:26.466668 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:26.475445 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:26.591715 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.592090 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.592454 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.592813 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.593166 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.593516 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.594300 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.594300 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.594549 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.594888 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.595253 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.595604 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:24:26.604639 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:26.621274 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Made reservation on behalf of ddfbe809b7ae4afba7cc3bc0c9fc5984 for: {'port': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:24:26.624835 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:26.645247 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Attempting to bind port 6fcb7112-8b10-4db0-8244-62d90add9bad on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:24:26.645838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Attempting to bind port 6fcb7112-8b10-4db0-8244-62d90add9bad by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:24:26.646045 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Attempting to bind port 6fcb7112-8b10-4db0-8244-62d90add9bad on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:24:26.650818 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Port 6fcb7112-8b10-4db0-8244-62d90add9bad on network a02876f9-a796-4512-9044-eb08bb5d54c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:24:26.651266 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Attempting to bind port 6fcb7112-8b10-4db0-8244-62d90add9bad on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:24:26.656606 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:24:26.656942 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Checking segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92422) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:24:26.657497 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Bound using segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} {{(pid=92422) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:24:26.657932 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.managers [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Bound port: 6fcb7112-8b10-4db0-8244-62d90add9bad, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}}] {{(pid=92422) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:24:26.658306 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:26.752393 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] For port 6fcb7112-8b10-4db0-8244-62d90add9bad, host hv-cinder-68948, cleared binding levels {{(pid=92422) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:24:26.753537 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6d3d0f5-97a4-4d8e-ba2c-043eba85c316 req-9d3e9cb1-b95d-42b9-90b5-6a5f3b4a5881 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:26.755020 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6d3d0f5-97a4-4d8e-ba2c-043eba85c316 req-9d3e9cb1-b95d-42b9-90b5-6a5f3b4a5881 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.1848800
May 20 16:24:26.755513 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] For port 6fcb7112-8b10-4db0-8244-62d90add9bad, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6fcb7112-8b10-4db0-8244-62d90add9bad,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92422) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:24:26.848892 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6d3d0f5-97a4-4d8e-ba2c-043eba85c316 req-1606e187-96bc-4ab8-925a-92b6ad58a7d1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0876904
May 20 16:24:26.858072 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Allocated IP 172.20.0.7 (77fd2be7-62d4-4a17-a108-9198b949900a/aa2b66ba-5130-41c9-9666-93c8e6eedee4/224f3f0d-380f-45af-8889-4430982438fe) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:24:26.904022 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:26.904022 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:26.946472 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:26.947041 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:26.948627 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] 10.222.0.16 "PUT /v2.0/ports/6fcb7112-8b10-4db0-8244-62d90add9bad HTTP/1.1" status: 200  len: 1094 time: 1.3196552
May 20 16:24:26.955653 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:26.976030 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Pushing event updated for resources: {'Port': ['ID=6fcb7112-8b10-4db0-8244-62d90add9bad,revision_number=3']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:26.979430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:27.000527 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'status': 'completed', 'code': 200}
May 20 16:24:27.061578 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:27.079679 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Transition to ACTIVE for port object 224f3f0d-380f-45af-8889-4430982438fe will not be triggered until provisioned by entity DHCP. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:24:27.100163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638b4b20-29ad-4805-970f-ee1d58cdb408 req-b813936e-b1e2-4305-b114-ca1a60a1c69b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.101678 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-638b4b20-29ad-4805-970f-ee1d58cdb408 req-b813936e-b1e2-4305-b114-ca1a60a1c69b service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 1097 time: 0.0813482
May 20 16:24:27.204711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:27.210426 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:27.253695 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638b4b20-29ad-4805-970f-ee1d58cdb408 req-92fb8f37-ecce-4860-8c56-01d462df541d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.255157 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-638b4b20-29ad-4805-970f-ee1d58cdb408 req-92fb8f37-ecce-4860-8c56-01d462df541d service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1430666
May 20 16:24:27.287311 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Network 77fd2be7-62d4-4a17-a108-9198b949900a is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:24:27.290437 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:24:27.294252 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:24:27.329106 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:27.334262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:27.369803 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.370438 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:27.410977 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638b4b20-29ad-4805-970f-ee1d58cdb408 req-bd8b419f-6523-4c0b-b23b-4fc4ed420f10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.412464 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-638b4b20-29ad-4805-970f-ee1d58cdb408 req-bd8b419f-6523-4c0b-b23b-4fc4ed420f10 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1505742
May 20 16:24:27.467377 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1807511
May 20 16:24:27.480878 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Request body: {'port': {'device_id': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:27.537380 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-84b0ff9f-d256-4e94-800f-3cb41586730f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.538899 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-84b0ff9f-d256-4e94-800f-3cb41586730f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 1097 time: 0.0828919
May 20 16:24:27.613249 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-1714aed7-4a17-4b63-a5dd-2bc4934ed7f9 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6fcb7112-8b10-4db0-8244-62d90add9bad HTTP/1.1" status: 200  len: 217 time: 0.0665483
May 20 16:24:27.635529 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-0e2b3daf-7a7a-461e-b490-3b32b7612f23 None None] Provisioning for port 224f3f0d-380f-45af-8889-4430982438fe completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:24:27.640896 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-0e2b3daf-7a7a-461e-b490-3b32b7612f23 None None] Provisioning complete for port 224f3f0d-380f-45af-8889-4430982438fe triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:24:27.641365 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-0e2b3daf-7a7a-461e-b490-3b32b7612f23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:27.641509 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b26cf8f-dfc1-425b-b98a-4ace140f47ef req-95fe9823-a91c-416d-8ead-0f16b01cba50 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.642157 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-6b26cf8f-dfc1-425b-b98a-4ace140f47ef req-95fe9823-a91c-416d-8ead-0f16b01cba50 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Synchronizing usage tracker for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:24:27.676225 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-8196c123-a2f1-4826-a1b0-2fab3f816d35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.677957 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-8196c123-a2f1-4826-a1b0-2fab3f816d35 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0588574
May 20 16:24:27.697483 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-0e2b3daf-7a7a-461e-b490-3b32b7612f23 None None] Port 224f3f0d-380f-45af-8889-4430982438fe cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:24:27.710744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:27.758481 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba949157-8cad-4500-928b-519b2d62fab3 req-d25f7b23-7489-4df3-ba70-d6191e4fd105 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:27.759755 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-d25f7b23-7489-4df3-ba70-d6191e4fd105 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0759509
May 20 16:24:27.770442 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-6b26cf8f-dfc1-425b-b98a-4ace140f47ef req-95fe9823-a91c-416d-8ead-0f16b01cba50 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Unset dirty status for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:24:27.771603 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b26cf8f-dfc1-425b-b98a-4ace140f47ef req-95fe9823-a91c-416d-8ead-0f16b01cba50 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 931 time: 0.3648920
May 20 16:24:27.881364 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6b26cf8f-dfc1-425b-b98a-4ace140f47ef req-98d2e3ec-886e-47b5-9edc-66ca8da64c49 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1026161
May 20 16:24:27.895285 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-21f47dab-317e-4743-be7e-62400c018aa1 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1287367
May 20 16:24:28.030618 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ba949157-8cad-4500-928b-519b2d62fab3 req-4f8c95ab-0617-4b78-b3cb-f7d7aa1620fb service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1291587
May 20 16:24:28.106501 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ec38ce-561d-47b0-8cbe-ac9e78a3eae2 req-b14accab-1b6a-429f-95f3-32d96b9a215f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:28.107995 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a4ec38ce-561d-47b0-8cbe-ac9e78a3eae2 req-b14accab-1b6a-429f-95f3-32d96b9a215f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.1332185
May 20 16:24:28.189955 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 224f3f0d-380f-45af-8889-4430982438fe {{(pid=92421) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:24:28.201818 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:28.210245 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a4ec38ce-561d-47b0-8cbe-ac9e78a3eae2 req-77477ff4-5a37-468d-b759-48f3efeb6a6c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0693531
May 20 16:24:28.222328 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Transition to ACTIVE for port object 224f3f0d-380f-45af-8889-4430982438fe will not be triggered until provisioned by entity L2. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:24:28.301359 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:28.305134 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:28.456955 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:28.464786 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:28.535937 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Attempting to bind port 224f3f0d-380f-45af-8889-4430982438fe on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:24:28.536558 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Attempting to bind port 224f3f0d-380f-45af-8889-4430982438fe by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:24:28.536558 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Attempting to bind port 224f3f0d-380f-45af-8889-4430982438fe on network 77fd2be7-62d4-4a17-a108-9198b949900a {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:24:28.541032 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Port 224f3f0d-380f-45af-8889-4430982438fe on network 77fd2be7-62d4-4a17-a108-9198b949900a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:24:28.541347 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Attempting to bind port 224f3f0d-380f-45af-8889-4430982438fe on network 77fd2be7-62d4-4a17-a108-9198b949900a {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:24:28.546578 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 23, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:24:28.546908 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Checking segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:24:28.547307 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Bound using segment: {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:24:28.547725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Bound port: 224f3f0d-380f-45af-8889-4430982438fe, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a'}}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:24:28.548064 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:28.638875 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, cleared binding levels {{(pid=92421) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:24:28.641751 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92421) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:24:28.770374 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:28.774317 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:28.832266 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:28.832885 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:28.834245 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] 10.222.0.16 "PUT /v2.0/ports/224f3f0d-380f-45af-8889-4430982438fe HTTP/1.1" status: 200  len: 1093 time: 1.3583887
May 20 16:24:28.834763 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'tag': '224f3f0d-380f-45af-8889-4430982438fe'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:28.858863 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=3']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:28.858863 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:28.888579 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'tag': '224f3f0d-380f-45af-8889-4430982438fe', 'status': 'completed', 'code': 200}
May 20 16:24:28.987575 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b1cfce-343b-4141-9f49-2bb8c8be7c6e req-bc3d829c-e4fb-4d7a-869e-8237b631c6a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:28.989363 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-30b1cfce-343b-4141-9f49-2bb8c8be7c6e req-bc3d829c-e4fb-4d7a-869e-8237b631c6a6 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1096 time: 0.0819206
May 20 16:24:29.195554 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b1cfce-343b-4141-9f49-2bb8c8be7c6e req-6e57a9a9-003b-4938-a3b0-2bb2a5fa12ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:29.196901 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-30b1cfce-343b-4141-9f49-2bb8c8be7c6e req-6e57a9a9-003b-4938-a3b0-2bb2a5fa12ca service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&shared=False HTTP/1.1" status: 200  len: 918 time: 0.2004466
May 20 16:24:29.209189 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349173b9-ef01-4c24-aa6c-66972c117b26 req-ea1c34fb-d1bb-4af7-8943-d4246f2b0ec5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:29.210580 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-349173b9-ef01-4c24-aa6c-66972c117b26 req-ea1c34fb-d1bb-4af7-8943-d4246f2b0ec5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.1889107
May 20 16:24:29.318499 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:29.394964 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-349173b9-ef01-4c24-aa6c-66972c117b26 req-a7ca7a35-3574-4800-9540-0f5af475a3ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1645415
May 20 16:24:29.438779 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b1cfce-343b-4141-9f49-2bb8c8be7c6e req-bed4de2d-d852-448a-8aae-0ac4c1cfa336 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:29.440278 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-30b1cfce-343b-4141-9f49-2bb8c8be7c6e req-bed4de2d-d852-448a-8aae-0ac4c1cfa336 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2288363
May 20 16:24:29.461762 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d886540-cc45-4b17-9093-530f70e64d27 req-2985e20f-eeff-4914-9817-d628833a824b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:29.463142 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1d886540-cc45-4b17-9093-530f70e64d27 req-2985e20f-eeff-4914-9817-d628833a824b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.1293461
May 20 16:24:29.559070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1d886540-cc45-4b17-9093-530f70e64d27 req-72a7c182-c69f-4c93-8c8d-9d23a6c06a57 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0900126
May 20 16:24:29.577651 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-9594d270-6e22-4cc9-8026-0c6103414dd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:29.579158 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-9594d270-6e22-4cc9-8026-0c6103414dd4 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1096 time: 0.0941195
May 20 16:24:29.733695 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-0ff2b087-52df-41bd-b862-663bcdb184e0 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=224f3f0d-380f-45af-8889-4430982438fe HTTP/1.1" status: 200  len: 217 time: 0.1466184
May 20 16:24:29.798130 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-6454df01-753b-482c-a3ff-df3f44549789 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:29.799774 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-6454df01-753b-482c-a3ff-df3f44549789 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0604923
May 20 16:24:29.873565 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-23d456ce-084f-482b-8a86-a5e92ff27618 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:29.875004 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-23d456ce-084f-482b-8a86-a5e92ff27618 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0695400
May 20 16:24:30.013511 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-b1b3588e-3857-4577-b8b5-dac041c22861 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1231017
May 20 16:24:30.137893 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-53b06dae-2cb6-42e6-ba34-0da15127a65f req-ddb98ee0-dac3-452b-accd-4b33b4f706e2 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1262014
May 20 16:24:30.586049 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03469f06-8f86-4930-b8a1-105070c3b27a req-c55b649b-a608-4976-b8d5-b83d8b8ab9fb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:30.587551 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03469f06-8f86-4930-b8a1-105070c3b27a req-c55b649b-a608-4976-b8d5-b83d8b8ab9fb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0840688
May 20 16:24:30.632649 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-03469f06-8f86-4930-b8a1-105070c3b27a req-1403f5e6-f46c-45fb-9bba-1b1fc6cd104b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390854
May 20 16:24:30.741690 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f5e385-5c83-48a7-98ca-4b8bfae7e156 req-2b477d82-27dd-4667-93c8-d96c240f23c3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:30.743038 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-92f5e385-5c83-48a7-98ca-4b8bfae7e156 req-2b477d82-27dd-4667-93c8-d96c240f23c3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.0783372
May 20 16:24:30.786754 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-92f5e385-5c83-48a7-98ca-4b8bfae7e156 req-77218473-97b6-447f-bd38-5f68969f64b2 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379889
May 20 16:24:31.827051 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51837ee6-1277-40c6-b48d-face2de71ecd req-abc56e84-21ea-464c-a773-7bfcb4656951 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:31.828570 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-51837ee6-1277-40c6-b48d-face2de71ecd req-abc56e84-21ea-464c-a773-7bfcb4656951 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0820010
May 20 16:24:31.874115 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-51837ee6-1277-40c6-b48d-face2de71ecd req-90d492d8-16d9-4dca-8db1-bf0e41770bf6 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391974
May 20 16:24:31.970476 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6f75ce-bc5b-4deb-8a1d-b67c526b348a req-f50d801f-6ea9-465b-aabf-91bed36edf8d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:31.972609 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ae6f75ce-bc5b-4deb-8a1d-b67c526b348a req-f50d801f-6ea9-465b-aabf-91bed36edf8d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.0826409
May 20 16:24:32.016084 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ae6f75ce-bc5b-4deb-8a1d-b67c526b348a req-1d8332fe-1143-4295-8393-9e7cc531302a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0374231
May 20 16:24:33.062978 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3eb4931-099d-495b-b234-d33904a23eec req-a0330c60-e919-4a71-bdfd-25c2f159ff54 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:33.064500 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3eb4931-099d-495b-b234-d33904a23eec req-a0330c60-e919-4a71-bdfd-25c2f159ff54 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0807416
May 20 16:24:33.110601 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e3eb4931-099d-495b-b234-d33904a23eec req-ace9026b-c3d9-4fad-89d0-8c9e95eda5c7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397100
May 20 16:24:33.205422 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c2eacd-2510-4e91-b21b-d5b1172d4188 req-3f9b4a23-37d9-405b-8736-cf99069d4020 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:33.207361 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e8c2eacd-2510-4e91-b21b-d5b1172d4188 req-3f9b4a23-37d9-405b-8736-cf99069d4020 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.0845172
May 20 16:24:33.252638 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e8c2eacd-2510-4e91-b21b-d5b1172d4188 req-b81864d2-5e5d-491b-b295-992115511164 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393746
May 20 16:24:34.258661 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:24:34.300322 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1e7adb-3e2b-4b6e-ace1-205e1ea236b1 req-a3627cb6-6809-499a-8b84-9cdebba0f9ea tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:34.301917 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff1e7adb-3e2b-4b6e-ace1-205e1ea236b1 req-a3627cb6-6809-499a-8b84-9cdebba0f9ea tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0822151
May 20 16:24:34.351554 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff1e7adb-3e2b-4b6e-ace1-205e1ea236b1 req-18c29c84-4251-4028-b12d-f38e8dbce6ae tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440853
May 20 16:24:34.398276 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:34.412383 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '224f3f0d-380f-45af-8889-4430982438fe', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'port_id': '224f3f0d-380f-45af-8889-4430982438fe', 'mac_address': 'fa:16:3e:5a:5b:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:24:34.439796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af55263-57eb-44c1-a412-f7fa36ead1a0 req-5f87a8d2-6d96-4f3f-b6d5-411f96451638 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:34.441830 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1af55263-57eb-44c1-a412-f7fa36ead1a0 req-5f87a8d2-6d96-4f3f-b6d5-411f96451638 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.0806382
May 20 16:24:34.471394 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:34.486927 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1af55263-57eb-44c1-a412-f7fa36ead1a0 req-bc2c4542-6a33-4a92-b8c5-50a7621df694 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394075
May 20 16:24:34.488398 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 224f3f0d-380f-45af-8889-4430982438fe {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:24:34.504195 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:34.586455 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:34.589256 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:34.654376 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:34.657399 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:35.021571 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['224f3f0d-380f-45af-8889-4430982438fe'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:24:35.545390 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d4cd63-7d99-4c3a-98a5-1c5e55ff2dd6 req-31d455c3-8f3d-45c8-9f4a-ab66914a7165 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:35.546990 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-63d4cd63-7d99-4c3a-98a5-1c5e55ff2dd6 req-31d455c3-8f3d-45c8-9f4a-ab66914a7165 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 944 time: 0.0836279
May 20 16:24:35.592131 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-63d4cd63-7d99-4c3a-98a5-1c5e55ff2dd6 req-e33fc2b6-fb0d-4119-af02-63d0149a5318 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389161
May 20 16:24:35.672960 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcab61b0-8e86-4585-b644-c059fce46a7c req-b3e78bd3-8ad6-47e5-8590-acec88861f5e tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:35.674377 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fcab61b0-8e86-4585-b644-c059fce46a7c req-b3e78bd3-8ad6-47e5-8590-acec88861f5e tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 944 time: 0.0800607
May 20 16:24:35.718633 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fcab61b0-8e86-4585-b644-c059fce46a7c req-b1ef7e11-9fc4-4978-8b13-f26c8361043e tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383656
May 20 16:24:36.254424 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6fcb7112-8b10-4db0-8244-62d90add9bad details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:24:36.257958 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:24:36.446139 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 6fcb7112-8b10-4db0-8244-62d90add9bad, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6fcb7112-8b10-4db0-8244-62d90add9bad,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:36.459741 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'port_id': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'mac_address': 'fa:16:3e:f4:eb:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 637, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:24:36.494000 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 224f3f0d-380f-45af-8889-4430982438fe completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:24:36.510791 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 224f3f0d-380f-45af-8889-4430982438fe triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:24:36.511089 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:36.566630 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:36.589005 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6fcb7112-8b10-4db0-8244-62d90add9bad {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:24:36.609279 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 6fcb7112-8b10-4db0-8244-62d90add9bad, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6fcb7112-8b10-4db0-8244-62d90add9bad,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:36.666258 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:36.688631 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:36.691289 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:36.724074 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:36.752811 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:36.772683 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe', 'code': 200}
May 20 16:24:36.776598 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=6fcb7112-8b10-4db0-8244-62d90add9bad,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:36.792833 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:36.797457 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cea7af6-edec-4a25-bfe8-ba93656cecb2 req-3ab1f5cf-5571-4f5e-8cc4-90c80abbbedc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:36.798961 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2cea7af6-edec-4a25-bfe8-ba93656cecb2 req-3ab1f5cf-5571-4f5e-8cc4-90c80abbbedc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 944 time: 0.0915830
May 20 16:24:36.822009 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:36.826757 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:36.867841 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2cea7af6-edec-4a25-bfe8-ba93656cecb2 req-9e83003d-0fd6-479d-9e87-48b0d16d4dda tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0616198
May 20 16:24:36.898726 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:36.901883 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:36.949381 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea94d3c8-ea23-404e-bf5f-0fd7e5ba3251 req-df128fb8-ac46-41ec-8555-726053a3da26 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:36.950842 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ea94d3c8-ea23-404e-bf5f-0fd7e5ba3251 req-df128fb8-ac46-41ec-8555-726053a3da26 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 945 time: 0.0817184
May 20 16:24:36.998031 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ea94d3c8-ea23-404e-bf5f-0fd7e5ba3251 req-d40ed4e5-964d-4c07-bc4c-e0ef10f73714 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414636
May 20 16:24:37.094184 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['6fcb7112-8b10-4db0-8244-62d90add9bad'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:24:37.299862 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa2e291-906f-4829-b486-c9c5ef6bc2fd req-cc2623d1-081b-490a-be50-f8b2701f1787 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:37.301873 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9aa2e291-906f-4829-b486-c9c5ef6bc2fd req-cc2623d1-081b-490a-be50-f8b2701f1787 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1098 time: 0.1565053
May 20 16:24:37.342274 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9aa2e291-906f-4829-b486-c9c5ef6bc2fd req-df2292bd-351b-4a3e-8b18-ea124d4a98ec service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0342510
May 20 16:24:38.062595 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bfe8471-66a1-44f2-be29-60a2a91304f8 req-91dda33d-679c-4d89-92ea-ed47090be95d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:38.064119 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4bfe8471-66a1-44f2-be29-60a2a91304f8 req-91dda33d-679c-4d89-92ea-ed47090be95d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0834296
May 20 16:24:38.144723 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4bfe8471-66a1-44f2-be29-60a2a91304f8 req-43ab25da-010b-41c0-95e5-8d87e26af2bb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0741098
May 20 16:24:38.188240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe1ad5f-71a2-4800-a4e2-2fae9149ab5f req-353f1254-1ad8-4f48-8701-d3ba471a30b6 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:38.189686 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3fe1ad5f-71a2-4800-a4e2-2fae9149ab5f req-353f1254-1ad8-4f48-8701-d3ba471a30b6 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 945 time: 0.0855639
May 20 16:24:38.237685 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3fe1ad5f-71a2-4800-a4e2-2fae9149ab5f req-60361a00-8a3a-4dc9-aad1-6e4ccd2c3240 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417180
May 20 16:24:39.337795 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf86d260-7fb9-496f-ab05-5bc69579047c req-3eefca50-310c-42a1-aa8f-e3cedcb1ffb4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:39.339280 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cf86d260-7fb9-496f-ab05-5bc69579047c req-3eefca50-310c-42a1-aa8f-e3cedcb1ffb4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0802720
May 20 16:24:39.433425 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cf86d260-7fb9-496f-ab05-5bc69579047c req-5d6dde82-e5a5-4bf9-b30e-0fc82f5ed84b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0608473
May 20 16:24:39.455068 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56548758-2848-489f-8e4b-3e0838a936f0 req-c2e164f2-d176-4d24-b800-b913b82377a0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:39.457048 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-56548758-2848-489f-8e4b-3e0838a936f0 req-c2e164f2-d176-4d24-b800-b913b82377a0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 945 time: 0.1144607
May 20 16:24:39.502187 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-56548758-2848-489f-8e4b-3e0838a936f0 req-628e65dc-14bd-4ecc-896c-eca918a0a28a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393376
May 20 16:24:39.616500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441c5bb0-a275-4aa8-8a71-3975eaa7c114 req-ad44bcf2-642d-4f03-b436-f20f9bbaaf1f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:39.617936 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-441c5bb0-a275-4aa8-8a71-3975eaa7c114 req-ad44bcf2-642d-4f03-b436-f20f9bbaaf1f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0793023
May 20 16:24:39.627685 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 37598) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:39.632873 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Request body: {'floatingip': {'port_id': '224f3f0d-380f-45af-8889-4430982438fe'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:39.707358 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:40.263397 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6fcb7112-8b10-4db0-8244-62d90add9bad up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:24:40.383711 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:40.423681 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 6fcb7112-8b10-4db0-8244-62d90add9bad completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:24:40.428724 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 6fcb7112-8b10-4db0-8244-62d90add9bad triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:24:40.429099 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:40.492752 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:40.547457 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:40.579584 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:40.596616 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 6fcb7112-8b10-4db0-8244-62d90add9bad, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6fcb7112-8b10-4db0-8244-62d90add9bad,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:24:40.629169 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'code': 200}
May 20 16:24:40.663854 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:40.665796 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:40.674185 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Floating IP 95418600-8ffa-46a1-bb0e-4982935c0ab2 associated. External IP: 172.27.0.66, port: 224f3f0d-380f-45af-8889-4430982438fe.
May 20 16:24:40.710239 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf572ce-ec4c-4e4a-9ba2-a507697f88f9 req-65c9aacd-90f2-4a87-8d84-deeb4364c6d2 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:40.711854 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf572ce-ec4c-4e4a-9ba2-a507697f88f9 req-65c9aacd-90f2-4a87-8d84-deeb4364c6d2 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 945 time: 0.0966420
May 20 16:24:40.734644 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=6fcb7112-8b10-4db0-8244-62d90add9bad,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:40.737756 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:40.768456 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf572ce-ec4c-4e4a-9ba2-a507697f88f9 req-9b3fb658-3df4-4b4f-88ec-2b461d368d57 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0498641
May 20 16:24:41.038127 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Router 7ca2542d-958b-4848-b460-42f1d2b2dd11 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:24:41.073301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5ee157-bc69-426e-977a-7b9428a7c3e3 req-91569eb4-07d1-4875-a3e7-998eb19763ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:41.074791 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9d5ee157-bc69-426e-977a-7b9428a7c3e3 req-91569eb4-07d1-4875-a3e7-998eb19763ae service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 1099 time: 0.0704653
May 20 16:24:41.119909 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9d5ee157-bc69-426e-977a-7b9428a7c3e3 req-62828d36-4e89-4fde-aead-9035345af169 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386198
May 20 16:24:41.217358 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:24:41.222430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:41.233315 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] Sync routers for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:24:41.236707 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:41.237343 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711beab80>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:24:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:41.281934 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-90cfa8eb-5d06-485e-9193-2c6e6bb08fc2 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "PUT /v2.0/floatingips/95418600-8ffa-46a1-bb0e-4982935c0ab2 HTTP/1.1" status: 200  len: 990 time: 1.6531224
May 20 16:24:41.282661 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'tag': '224f3f0d-380f-45af-8889-4430982438fe'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:41.336147 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'tag': '224f3f0d-380f-45af-8889-4430982438fe', 'status': 'completed', 'code': 200}
May 20 16:24:41.418213 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:41.470840 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-6e79990d-7af9-40d4-b729-bb46dbaaa245 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:41.472836 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-6e79990d-7af9-40d4-b729-bb46dbaaa245 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1098 time: 0.0733256
May 20 16:24:41.605483 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-5777589b-5789-48a3-b4d3-f66d08a1c00e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:41.606924 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-5777589b-5789-48a3-b4d3-f66d08a1c00e service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1270106
May 20 16:24:41.712758 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-079dc792-f643-4b7f-8a35-b71588df3a86 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=224f3f0d-380f-45af-8889-4430982438fe HTTP/1.1" status: 200  len: 998 time: 0.0980489
May 20 16:24:41.777203 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-d1b89589-94e9-4994-a08e-92ff0e9afa70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:41.778638 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-d1b89589-94e9-4994-a08e-92ff0e9afa70 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0586336
May 20 16:24:41.791539 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711beab80>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '95418600-8ffa-46a1-bb0e-4982935c0ab2', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'floating_ip_address': '172.27.0.66', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'port_id': '224f3f0d-380f-45af-8889-4430982438fe', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 579, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'mac_address': 'fa:16:3e:5a:5b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:22Z', 'updated_at': '2021-05-20T16:24:40Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:41.795653 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] Checking router: 7ca2542d-958b-4848-b460-42f1d2b2dd11 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:24:41.805127 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:41.805491 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711beab80>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:24:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:41.859367 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-bed36813-55fb-447d-b8e3-388b65b0568c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:41.860831 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-bed36813-55fb-447d-b8e3-388b65b0568c service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0755408
May 20 16:24:41.984896 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:42.049796 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-7a1d9d44-d6e8-4fc4-ad8d-8276c12e587e service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1777837
May 20 16:24:42.064944 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ababe516-08b5-442c-b105-87d35b15a598 req-5c85ebe5-04f6-4c7f-b9d8-774553744a32 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:42.066291 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ababe516-08b5-442c-b105-87d35b15a598 req-5c85ebe5-04f6-4c7f-b9d8-774553744a32 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 946 time: 0.1741660
May 20 16:24:42.197720 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ababe516-08b5-442c-b105-87d35b15a598 req-956c798d-836f-4748-bfb6-5eeba2e34d5b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1127470
May 20 16:24:42.231835 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52fa717d-ad72-47c0-9705-3f2ed14f0942 req-a7659a60-aa4f-4732-83fa-2f57962c9f83 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1642358
May 20 16:24:42.339278 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711beab80>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '95418600-8ffa-46a1-bb0e-4982935c0ab2', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'floating_ip_address': '172.27.0.66', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'port_id': '224f3f0d-380f-45af-8889-4430982438fe', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 579, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'mac_address': 'fa:16:3e:5a:5b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:22Z', 'updated_at': '2021-05-20T16:24:40Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:42.343156 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56e3510-6bc6-4ba5-866e-7e7792d058cc None None] The sync data for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi is: [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '95418600-8ffa-46a1-bb0e-4982935c0ab2', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'floating_ip_address': '172.27.0.66', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'port_id': '224f3f0d-380f-45af-8889-4430982438fe', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 579, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'mac_address': 'fa:16:3e:5a:5b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:22Z', 'updated_at': '2021-05-20T16:24:40Z', 'revision_number': 1, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:24:42.527545 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2361a82-e5f3-476f-8ea4-eb3e5eadc7d2 None None] New status for floating IP 95418600-8ffa-46a1-bb0e-4982935c0ab2: ACTIVE {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:24:43.466584 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43f893f-d4f4-45e1-a59d-f95c1f16f67d req-f2ccbb18-3663-4aec-ace8-3f8947672619 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:43.468079 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a43f893f-d4f4-45e1-a59d-f95c1f16f67d req-f2ccbb18-3663-4aec-ace8-3f8947672619 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 946 time: 0.1599147
May 20 16:24:43.512469 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a43f893f-d4f4-45e1-a59d-f95c1f16f67d req-b0d958d4-f19a-4a16-beff-c2a42b4ec90b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380375
May 20 16:24:43.698449 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b714d6-9c0d-43ad-afb8-091de01deb5d req-414700bd-4236-45d9-b94c-b41cf5cecb66 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:43.699912 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-55b714d6-9c0d-43ad-afb8-091de01deb5d req-414700bd-4236-45d9-b94c-b41cf5cecb66 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 946 time: 0.0806575
May 20 16:24:43.744279 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-55b714d6-9c0d-43ad-afb8-091de01deb5d req-5b796f5c-26cd-4302-b057-26ebf4f2c44e tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385916
May 20 16:24:43.767124 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37622) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:43.876905 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a87bbf1d-d35e-4999-84d5-65003592f701 tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:43.878489 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a87bbf1d-d35e-4999-84d5-65003592f701 tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 1094 time: 0.1103783
May 20 16:24:43.881292 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 37628) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:24:43.886257 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'port_id': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address': '172.20.0.11'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:24:43.892063 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:24:43.896497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:floatingip and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:24:43.899404 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:24:43.905210 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:24:43.986844 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:44.122567 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:44.267266 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Allocated IP 172.27.0.58 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/714997cf-7ef6-4ebf-b6d9-21085584b249) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:24:44.431646 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:44.561347 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:44.565245 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:44.635311 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:24:44.638186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:24:44.640803 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:24:44.679734 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=714997cf-7ef6-4ebf-b6d9-21085584b249,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:44.682784 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:45.054083 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:45.180407 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:45.383369 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:45.483943 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:45.488089 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-39e38edc-00f3-4515-8876-58273ff6d7b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:24:45.673782 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=714997cf-7ef6-4ebf-b6d9-21085584b249,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:24:45.678167 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:24:45.684541 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:45.853157 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Floating IP 90d279ad-f91e-4479-bd2a-ff38cba18b35 associated. External IP: 172.27.0.58, port: 6fcb7112-8b10-4db0-8244-62d90add9bad.
May 20 16:24:45.886938 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9232951e-2860-4bd4-9e19-23431d3b7738 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:46.198752 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:24:46.375530 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:24:46.385419 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:24:46.395662 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:46.396601 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712532ac0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:24:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:46.510193 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:46.569792 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.6874800
May 20 16:24:46.570460 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:24:46.578886 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:46.617304 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'status': 'completed', 'code': 200}
May 20 16:24:46.745104 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-6fcc1c0f-6c3e-41f6-9e5e-b4b9ce2396a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:46.746694 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-6fcc1c0f-6c3e-41f6-9e5e-b4b9ce2396a2 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 1099 time: 0.0945735
May 20 16:24:46.934651 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712532ac0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '90d279ad-f91e-4479-bd2a-ff38cba18b35', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.58', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 583, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:f4:eb:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:44Z', 'updated_at': '2021-05-20T16:24:44Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:46.938417 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:24:46.941504 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-70d4b7ab-a5f9-4b70-a2cd-436e07f97529 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:46.942957 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-70d4b7ab-a5f9-4b70-a2cd-436e07f97529 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.1887410
May 20 16:24:46.947557 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:24:46.948149 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712532ac0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:24:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:46.954606 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fc9775-843e-487e-9edf-aed0c15b9e07 req-48c450cc-3261-4fbc-ad30-e244dd5006d8 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:46.956271 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8fc9775-843e-487e-9edf-aed0c15b9e07 req-48c450cc-3261-4fbc-ad30-e244dd5006d8 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1803935
May 20 16:24:47.083827 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c8fc9775-843e-487e-9edf-aed0c15b9e07 req-6aeb1123-3f00-4ba3-82ec-1bc00ed80a03 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0737727
May 20 16:24:47.089891 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-9be310fe-d035-472d-9c70-bc86219add18 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6fcb7112-8b10-4db0-8244-62d90add9bad HTTP/1.1" status: 200  len: 999 time: 0.1310825
May 20 16:24:47.159756 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-43b458d1-fe20-4586-a08f-85c941a6e115 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:47.161217 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-43b458d1-fe20-4586-a08f-85c941a6e115 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0593953
May 20 16:24:47.169759 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:24:47.244001 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-7682637b-4b51-4bdd-aced-8ef45f728ed2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:47.245413 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-7682637b-4b51-4bdd-aced-8ef45f728ed2 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0736387
May 20 16:24:47.489440 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-2b1ed806-aa34-45d7-ab61-e305631f2497 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2373316
May 20 16:24:47.523892 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712532ac0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '90d279ad-f91e-4479-bd2a-ff38cba18b35', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.58', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 583, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:f4:eb:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:44Z', 'updated_at': '2021-05-20T16:24:44Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:24:47.527941 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-848d0e83-9de2-4ff7-a868-5928cca4e780 None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '90d279ad-f91e-4479-bd2a-ff38cba18b35', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.58', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 583, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:f4:eb:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:24:44Z', 'updated_at': '2021-05-20T16:24:44Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:24:47.627222 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-44ea2efa-4a33-4cd6-8a35-7737d0155648 req-4b8a27af-fd8e-4763-a4ca-120425ac8f0f service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307385
May 20 16:24:47.724000 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d4b59d0-3278-4774-b3d6-18d7ba3c78ce None None] New status for floating IP 90d279ad-f91e-4479-bd2a-ff38cba18b35: ACTIVE {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:24:48.276987 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca777198-2812-4a4e-b67d-34d293bc40db req-1f5e42e8-0ac5-4e35-938e-caf1e562e664 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:48.278459 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ca777198-2812-4a4e-b67d-34d293bc40db req-1f5e42e8-0ac5-4e35-938e-caf1e562e664 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0813155
May 20 16:24:48.323480 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ca777198-2812-4a4e-b67d-34d293bc40db req-0d4db184-3356-4dff-bfc3-4d0d18b03c02 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391264
May 20 16:24:48.460740 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:48.660979 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4c2b69da-59dd-4c8b-a27f-448f787af852 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:49.507501 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-435888ff-21ff-48d2-8201-6c633b6e4bf9 req-3209dd19-75e3-4a5d-b9f0-c187f33897a5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:49.508840 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-435888ff-21ff-48d2-8201-6c633b6e4bf9 req-3209dd19-75e3-4a5d-b9f0-c187f33897a5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0817432
May 20 16:24:49.553587 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-435888ff-21ff-48d2-8201-6c633b6e4bf9 req-99557cbb-148c-4ef3-8bbd-49e0d5601fe5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390313
May 20 16:24:49.620413 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:50.740503 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a2bed84-b1e4-45d6-bc8d-7d830931781e req-0381daaa-3eeb-426c-9008-67bd8f8d5105 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:50.741940 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2a2bed84-b1e4-45d6-bc8d-7d830931781e req-0381daaa-3eeb-426c-9008-67bd8f8d5105 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0790546
May 20 16:24:50.789576 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2a2bed84-b1e4-45d6-bc8d-7d830931781e req-ca15aa3e-33ce-4c18-a108-1af07123679e tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420148
May 20 16:24:51.294983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:51.969702 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34873014-da64-4133-949d-d48a84d75f2c req-17525bd0-2d8e-4b6c-8c40-5c359cd32708 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:51.971150 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-34873014-da64-4133-949d-d48a84d75f2c req-17525bd0-2d8e-4b6c-8c40-5c359cd32708 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0784674
May 20 16:24:52.015307 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-34873014-da64-4133-949d-d48a84d75f2c req-09d0aae0-2688-4be5-97ae-6dee0dc10c7a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379622
May 20 16:24:53.201101 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a9812b-0449-4b51-b7af-da64b27f3370 req-5741c9e2-7b5e-4e33-9f8d-d53668fc3c7d tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:53.202537 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-95a9812b-0449-4b51-b7af-da64b27f3370 req-5741c9e2-7b5e-4e33-9f8d-d53668fc3c7d tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0842178
May 20 16:24:53.246251 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-95a9812b-0449-4b51-b7af-da64b27f3370 req-7f70e339-692b-4e58-8f2b-59cd27207c99 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379741
May 20 16:24:54.431589 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf02fb3-22aa-4b6e-9df8-3a9c22be6d2a req-dd3a6380-6bc5-4954-ad18-1ae382c7f504 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:54.433045 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1bf02fb3-22aa-4b6e-9df8-3a9c22be6d2a req-dd3a6380-6bc5-4954-ad18-1ae382c7f504 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0801005
May 20 16:24:54.476502 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1bf02fb3-22aa-4b6e-9df8-3a9c22be6d2a req-c3c1e3db-bdc6-45bd-9315-973723179742 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378509
May 20 16:24:55.665052 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf53bf1b-60a4-4edf-b43d-98f9b6960657 req-e3595b23-9b67-4ad8-87ae-42d39b6293bf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:55.666495 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf53bf1b-60a4-4edf-b43d-98f9b6960657 req-e3595b23-9b67-4ad8-87ae-42d39b6293bf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0844140
May 20 16:24:55.710292 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bf53bf1b-60a4-4edf-b43d-98f9b6960657 req-30508a3d-8e2d-4efa-ae42-0f3ed149610c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380311
May 20 16:24:55.963331 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:24:56.041113 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-7fcbbc10-f02c-4efa-8104-b0723ef9018e service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0702131
May 20 16:24:56.151048 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-b109cb08-f375-4392-9ac6-43afd31cd2f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:56.152536 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-b109cb08-f375-4392-9ac6-43afd31cd2f0 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1098 time: 0.0742044
May 20 16:24:56.296645 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-275d0de7-3b36-41df-a3e3-5d5f3f6cffbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:56.298089 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-275d0de7-3b36-41df-a3e3-5d5f3f6cffbe service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.1246786
May 20 16:24:56.399478 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-00cb99b3-4689-4efb-b1fb-55ecc3a0036d service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 1001 time: 0.0940883
May 20 16:24:56.461888 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-ef6cff53-4c34-46c2-90e3-22d32099904d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:56.463441 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-ef6cff53-4c34-46c2-90e3-22d32099904d service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.0581691
May 20 16:24:56.540963 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-77302090-8c0c-4be6-a5b7-9edfa6f67962 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:56.542539 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-77302090-8c0c-4be6-a5b7-9edfa6f67962 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0732462
May 20 16:24:56.672915 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-3be060b9-b73c-4da1-840e-e5f896359689 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1233778
May 20 16:24:56.943679 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a873bfe-6ab1-497e-93e0-74dae8b3d875 req-185a18d9-f675-4186-b36c-dda8a0394f4b service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2632568
May 20 16:24:56.963090 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f508c0fe-0d1e-41af-8af7-cd69a73d822e req-534bd37f-7e41-4e65-bd52-52970b47187f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:56.964521 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f508c0fe-0d1e-41af-8af7-cd69a73d822e req-534bd37f-7e41-4e65-bd52-52970b47187f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1168780
May 20 16:24:57.010522 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f508c0fe-0d1e-41af-8af7-cd69a73d822e req-6b26685c-f439-4761-8829-3d2bc0628919 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402579
May 20 16:24:58.196870 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151ecb91-9a14-4949-9f44-6aac55b007db req-e984fdf2-6e67-45d9-927e-5ab2b908cb85 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:58.198235 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-151ecb91-9a14-4949-9f44-6aac55b007db req-e984fdf2-6e67-45d9-927e-5ab2b908cb85 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0785975
May 20 16:24:58.243901 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-151ecb91-9a14-4949-9f44-6aac55b007db req-57ecf197-9a73-48d2-b648-8f5fda12d029 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398843
May 20 16:24:59.389425 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:24:59.437035 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e29ef780-91e7-4757-8035-c44edb384498 req-3fd38ed6-e365-4e9d-a2a6-55e365ff1d6a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:24:59.438485 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e29ef780-91e7-4757-8035-c44edb384498 req-3fd38ed6-e365-4e9d-a2a6-55e365ff1d6a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0856786
May 20 16:24:59.488479 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e29ef780-91e7-4757-8035-c44edb384498 req-76a4e936-d696-4832-8cd0-b71e93ccc51e tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441556
May 20 16:25:00.674623 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-946df4a2-9cac-4de2-a022-c9feaa0858f8 req-55fabe8d-11d0-4f4d-aee4-16340f8db4bc tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:00.676084 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-946df4a2-9cac-4de2-a022-c9feaa0858f8 req-55fabe8d-11d0-4f4d-aee4-16340f8db4bc tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0790188
May 20 16:25:00.723064 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-946df4a2-9cac-4de2-a022-c9feaa0858f8 req-971ba640-b4cd-4e30-95f9-b2aba9790642 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405436
May 20 16:25:01.907027 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c8c291-01d1-4d6a-9781-b3ecadd3770b req-b866135a-edcb-49a3-8ad4-8a7d26a041c4 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:01.908460 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-91c8c291-01d1-4d6a-9781-b3ecadd3770b req-b866135a-edcb-49a3-8ad4-8a7d26a041c4 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0798864
May 20 16:25:01.952690 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-91c8c291-01d1-4d6a-9781-b3ecadd3770b req-19b83f38-9362-468c-bf9e-ec1fb99666de tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386045
May 20 16:25:02.217228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-3da29c0a-0bcc-4e41-91cc-f3fe2aa7ff78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:02.219238 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-3da29c0a-0bcc-4e41-91cc-f3fe2aa7ff78 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1098 time: 0.0993111
May 20 16:25:02.353401 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-8addbf0a-9f69-4440-a9f8-1d74f29d17c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:02.354837 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-8addbf0a-9f69-4440-a9f8-1d74f29d17c3 service neutron] 10.222.0.16 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 910 time: 0.1279242
May 20 16:25:02.458838 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-bff8ef60-07fa-4930-8112-ddc5d7f32e69 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 1001 time: 0.0970230
May 20 16:25:02.522413 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-ed531130-4919-49c8-b08b-f0e182950c66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:02.523838 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-ed531130-4919-49c8-b08b-f0e182950c66 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 200  len: 848 time: 0.0583081
May 20 16:25:02.600326 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-2949a0e4-73a1-408c-8ff3-21375b2f8dcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:02.601943 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-2949a0e4-73a1-408c-8ff3-21375b2f8dcf service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=39834042-f759-400b-9bc0-eb7c7abdd5c0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0706072
May 20 16:25:02.734982 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-6191b581-e8c4-4357-a67d-e2b1f9c87796 service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1258323
May 20 16:25:02.869968 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b1c715f-66bc-47e4-adf0-1b9c4d599401 req-1d2aafad-c455-4862-a9be-c9a08a9577dc service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1276908
May 20 16:25:03.145593 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11c1dbb-35a4-439f-895e-ad218d21d48a req-e8839e12-1248-48b3-9422-3a7f27f004cd tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:03.146963 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e11c1dbb-35a4-439f-895e-ad218d21d48a req-e8839e12-1248-48b3-9422-3a7f27f004cd tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0846000
May 20 16:25:03.191525 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e11c1dbb-35a4-439f-895e-ad218d21d48a req-e412de1d-9aa3-4779-a97a-09d51d2c27de tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389059
May 20 16:25:04.375274 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde3237f-fe31-4746-a94a-71b2f69f3514 req-f3f29205-a52b-4a3f-a792-7097aae047cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:04.376741 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cde3237f-fe31-4746-a94a-71b2f69f3514 req-f3f29205-a52b-4a3f-a792-7097aae047cf tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0803928
May 20 16:25:04.501562 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cde3237f-fe31-4746-a94a-71b2f69f3514 req-8923de71-c40b-45f9-ae61-1abd788674c1 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1185138
May 20 16:25:05.687521 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe33eff3-30c6-4170-a0fb-eac2e9e9816c req-cfee3612-8498-406d-9d88-26ed26076322 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:05.688954 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fe33eff3-30c6-4170-a0fb-eac2e9e9816c req-cfee3612-8498-406d-9d88-26ed26076322 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0786729
May 20 16:25:05.733210 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fe33eff3-30c6-4170-a0fb-eac2e9e9816c req-fbb59bbc-0bad-4171-907b-f2cf2b57b101 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379279
May 20 16:25:06.916397 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66904e92-16e2-4660-8bc7-115181e88001 req-6f384e67-721c-496f-a704-b7ad672ee8a9 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:06.917836 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-66904e92-16e2-4660-8bc7-115181e88001 req-6f384e67-721c-496f-a704-b7ad672ee8a9 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0814750
May 20 16:25:06.961307 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-66904e92-16e2-4660-8bc7-115181e88001 req-f3d3feb5-0622-4cd9-abe7-dfb870d598db tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379241
May 20 16:25:07.526511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdaf2574-2796-49cd-8613-0c079ec125e1 req-fef0aa31-4965-4e3b-b602-15ee235595bc tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:07.528004 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cdaf2574-2796-49cd-8613-0c079ec125e1 req-fef0aa31-4965-4e3b-b602-15ee235595bc tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0809052
May 20 16:25:07.564294 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-7aee35ff-e68b-406c-b958-1f80e9fa0e3c service neutron] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.0732889
May 20 16:25:07.576678 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cdaf2574-2796-49cd-8613-0c079ec125e1 req-00927177-2d05-4d6c-9717-052a6826af9d tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426090
May 20 16:25:08.438991 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device df15e363-aade-4bfb-9359-102c4aa7cae5 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:25:08.551847 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:08.577738 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:25:08.588677 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:25:08.620973 dv-cinder-689486-13-iscsi neutron-server[92423]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'code': 422} returned with failed status
May 20 16:25:08.703425 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:08.705414 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:25:08.772003 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=6']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:25:08.777363 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d46223d9-5636-4bed-9ae2-099af53c97b7 req-ea700d0a-ea8f-45c2-91b6-cb00fa21fbd6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:08.778995 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d46223d9-5636-4bed-9ae2-099af53c97b7 req-ea700d0a-ea8f-45c2-91b6-cb00fa21fbd6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0823114
May 20 16:25:08.779329 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.779680 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.780013 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.780342 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.780667 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.780991 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.781363 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.781677 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.782012 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.782311 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.782627 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.782946 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:25:08.787533 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:25:08.823469 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d46223d9-5636-4bed-9ae2-099af53c97b7 req-e2782888-5905-4ed9-a5b5-04647fc049b0 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385990
May 20 16:25:10.015446 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41acbdc-6bb9-42f0-8720-022baabb93d0 req-a399f412-2f21-4d59-aef4-68e627d989c1 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:10.018301 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e41acbdc-6bb9-42f0-8720-022baabb93d0 req-a399f412-2f21-4d59-aef4-68e627d989c1 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0856416
May 20 16:25:10.060666 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e41acbdc-6bb9-42f0-8720-022baabb93d0 req-9164a09f-8397-41df-a1f5-85018f277c07 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379868
May 20 16:25:10.725099 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-cdf23a29-4515-45de-9a81-d6565612c686 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:10.726627 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-cdf23a29-4515-45de-9a81-d6565612c686 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b&tenant_id=b05498ab061b462e9f28e7d5e6bff55e HTTP/1.1" status: 200  len: 1096 time: 0.0695033
May 20 16:25:10.819012 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-d9552e81-1253-4e23-adfa-6adf4d2cdecf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:10.821117 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-d9552e81-1253-4e23-adfa-6adf4d2cdecf service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1096 time: 0.0723484
May 20 16:25:10.952056 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-9e3a158e-a69c-4b45-b27b-14fdb1ee5ec4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:10.953389 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-9e3a158e-a69c-4b45-b27b-14fdb1ee5ec4 service neutron] 10.222.0.16 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 910 time: 0.1229093
May 20 16:25:11.054967 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-cd7be857-ba52-4530-97ed-37e2e577732a service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 999 time: 0.0941899
May 20 16:25:11.116563 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-6a4b641c-fb5e-4b92-bc77-161a443d0af4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:11.118569 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-6a4b641c-fb5e-4b92-bc77-161a443d0af4 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 200  len: 848 time: 0.0571446
May 20 16:25:11.256768 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-1ac5a734-6227-49e6-b5f0-2a33d31b8c9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:11.258289 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-1ac5a734-6227-49e6-b5f0-2a33d31b8c9e service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=39834042-f759-400b-9bc0-eb7c7abdd5c0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1334093
May 20 16:25:11.266241 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfd5eea-f325-4eb5-99fd-5ebb02052cd5 req-f51aab56-2a61-41c1-982a-9073165aaf42 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:11.267638 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6bfd5eea-f325-4eb5-99fd-5ebb02052cd5 req-f51aab56-2a61-41c1-982a-9073165aaf42 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.1021702
May 20 16:25:11.396436 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6bfd5eea-f325-4eb5-99fd-5ebb02052cd5 req-5ddba59c-4f48-423a-87a8-eacc2a879fb5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1108301
May 20 16:25:11.424707 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-93a3d7fb-3b2a-4402-b108-380181483f76 service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1560853
May 20 16:25:11.553339 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-eeed7463-3929-4c80-8376-d0eaaeecb00f req-ec5d20e2-6542-4c22-89cd-176432b7f6ac service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1214435
May 20 16:25:12.586081 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d49700c-8310-43a2-a861-6261f8e14299 req-572f1411-1501-4445-84dc-0a22fa4d3053 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:12.587543 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1d49700c-8310-43a2-a861-6261f8e14299 req-572f1411-1501-4445-84dc-0a22fa4d3053 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0842044
May 20 16:25:12.632236 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1d49700c-8310-43a2-a861-6261f8e14299 req-a9cd2ff8-f8ca-4ea0-81a8-04690e9c2d4c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390668
May 20 16:25:13.812180 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43981baa-027a-4b8c-9491-cbc0b9f2c6f6 req-bdb4a664-cce0-4a2f-b0ea-58d55322480f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:13.813560 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-43981baa-027a-4b8c-9491-cbc0b9f2c6f6 req-bdb4a664-cce0-4a2f-b0ea-58d55322480f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0788999
May 20 16:25:13.937816 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-43981baa-027a-4b8c-9491-cbc0b9f2c6f6 req-5f8e6c41-f077-4d83-be09-503352e6738e tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1186254
May 20 16:25:15.119729 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef61041-69f1-4a23-b94b-f72f7c1409c7 req-b7e5f1fa-85e7-464a-a4cb-4cab2c5fb181 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:15.121163 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9ef61041-69f1-4a23-b94b-f72f7c1409c7 req-b7e5f1fa-85e7-464a-a4cb-4cab2c5fb181 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0789380
May 20 16:25:15.165093 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9ef61041-69f1-4a23-b94b-f72f7c1409c7 req-0ae859e0-ed98-46b0-af46-14cd5407ddbe tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382540
May 20 16:25:15.902812 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-1565be71-0786-46b1-b2e0-a87c0e4e5691 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:16.349982 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671baaa9-cca2-4132-b07c-29ad6b5b944d req-79933484-760b-4d85-ba86-eecbeb26c3ea tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:16.351433 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-671baaa9-cca2-4132-b07c-29ad6b5b944d req-79933484-760b-4d85-ba86-eecbeb26c3ea tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0816143
May 20 16:25:16.394705 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-671baaa9-cca2-4132-b07c-29ad6b5b944d req-4c88852b-b773-4af5-9615-2f35e583c1f5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0376444
May 20 16:25:17.586189 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acea3e52-9c56-4fec-b505-0d144943f6bc req-d29789e6-622c-4851-817b-f2981ebeef25 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:17.587688 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-acea3e52-9c56-4fec-b505-0d144943f6bc req-d29789e6-622c-4851-817b-f2981ebeef25 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0806983
May 20 16:25:17.635662 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-acea3e52-9c56-4fec-b505-0d144943f6bc req-65a75c32-350f-4f61-abb6-e604df30c511 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421278
May 20 16:25:18.446339 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:18.634079 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-e59c86f9-5a73-4eeb-9035-1645b7aa8e20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:18.819925 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab223883-4b58-47f0-b057-27b5d6a19f74 req-967e4b4d-5e1d-4130-9b70-bb0b01c12e04 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:18.821376 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab223883-4b58-47f0-b057-27b5d6a19f74 req-967e4b4d-5e1d-4130-9b70-bb0b01c12e04 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0806947
May 20 16:25:18.866322 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ab223883-4b58-47f0-b057-27b5d6a19f74 req-12efbbec-5bce-441a-8d5b-793d4ff929af tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390999
May 20 16:25:19.677547 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:20.060792 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef655fd8-5b00-431e-a682-7cadf54e0af2 req-2294d113-27c2-4557-a72c-ace94e058a0c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:20.062230 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ef655fd8-5b00-431e-a682-7cadf54e0af2 req-2294d113-27c2-4557-a72c-ace94e058a0c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 943 time: 0.0867803
May 20 16:25:20.105483 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ef655fd8-5b00-431e-a682-7cadf54e0af2 req-440b5b89-db0b-4a8c-a188-0af9a7fed359 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0374975
May 20 16:25:20.511747 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device df15e363-aade-4bfb-9359-102c4aa7cae5 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:25:20.639890 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:25:20.652416 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'port_id': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'mac_address': 'fa:16:3e:b7:cd:f0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 629, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:25:20.707882 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:20.723595 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id df15e363-aade-4bfb-9359-102c4aa7cae5 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:25:20.738215 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:25:20.803325 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:20.805617 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f25fd3e3-8772-4cd2-ae9d-8b408ca3d23d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:25:20.868067 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=7']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:25:20.870956 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:25:21.225902 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['df15e363-aade-4bfb-9359-102c4aa7cae5'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:25:21.288321 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:21.292648 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37481af-926f-48e1-9de8-76d53d89d23f req-f0d6c97b-0572-42d2-a699-fad4b5ce6ce8 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:21.293653 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c37481af-926f-48e1-9de8-76d53d89d23f req-f0d6c97b-0572-42d2-a699-fad4b5ce6ce8 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.0822611
May 20 16:25:21.338806 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c37481af-926f-48e1-9de8-76d53d89d23f req-0c856378-edc8-4b01-96c5-1e9a4994e58a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392976
May 20 16:25:22.521889 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6186e5d4-580c-4217-ac0a-c2b46b5fd3c3 req-158ae053-85c4-4691-97d2-3fe26b082fff tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:22.523249 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6186e5d4-580c-4217-ac0a-c2b46b5fd3c3 req-158ae053-85c4-4691-97d2-3fe26b082fff tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 944 time: 0.0802312
May 20 16:25:22.529706 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device df15e363-aade-4bfb-9359-102c4aa7cae5 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:25:22.569770 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6186e5d4-580c-4217-ac0a-c2b46b5fd3c3 req-be85aa80-eb07-4b38-967b-33c282238ea7 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398848
May 20 16:25:22.595419 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port df15e363-aade-4bfb-9359-102c4aa7cae5 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:25:22.595792 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:22.709241 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:22.734581 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:25:22.744482 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:25:22.780514 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'code': 200}
May 20 16:25:22.837993 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:22.839774 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:25:22.904855 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=8']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:25:22.907908 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:25:23.169291 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a30ddf-45f6-47f4-ae93-4a1fdb5e2adb req-475cc57e-74ae-4238-8106-35a6779fdad7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:23.170665 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52a30ddf-45f6-47f4-ae93-4a1fdb5e2adb req-475cc57e-74ae-4238-8106-35a6779fdad7 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1098 time: 0.0740104
May 20 16:25:23.210695 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52a30ddf-45f6-47f4-ae93-4a1fdb5e2adb req-a09912de-bd92-4687-b749-7651c55375f0 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0333593
May 20 16:25:23.754031 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12074877-83f8-46b7-89ae-fbc1b03b931d req-3fe4d67a-3213-41c9-9c18-833c875fea4f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:23.755414 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-12074877-83f8-46b7-89ae-fbc1b03b931d req-3fe4d67a-3213-41c9-9c18-833c875fea4f tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0780783
May 20 16:25:23.798624 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-12074877-83f8-46b7-89ae-fbc1b03b931d req-f9cb04fa-1e94-4f63-bffc-ef7f612ea9df tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378199
May 20 16:25:25.091656 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83005221-3262-4d3d-a66f-c250278af9cd req-d34734f8-0069-48a7-b1a9-f51715a4e5e6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:25.093019 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-83005221-3262-4d3d-a66f-c250278af9cd req-d34734f8-0069-48a7-b1a9-f51715a4e5e6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0834808
May 20 16:25:25.136888 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-83005221-3262-4d3d-a66f-c250278af9cd req-69f01d3d-8074-457c-9e9f-77406598a14b tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381985
May 20 16:25:29.346306 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:29.750850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df728040-b8fd-4e17-a585-a346ac2dbd96 req-6db67105-b20e-49cd-bbaf-b18a05c42a37 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:29.752434 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-df728040-b8fd-4e17-a585-a346ac2dbd96 req-6db67105-b20e-49cd-bbaf-b18a05c42a37 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.1392677
May 20 16:25:29.775072 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-26cdeacb-5d0b-49d6-826b-39a8a9e7255e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:29.776414 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-26cdeacb-5d0b-49d6-826b-39a8a9e7255e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1138 time: 0.1115725
May 20 16:25:29.839399 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-df728040-b8fd-4e17-a585-a346ac2dbd96 req-6c654b1f-c975-46d4-a9db-46d6da16182b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0789912
May 20 16:25:29.926112 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-fb5a65cb-795e-4107-9d15-7d3dd52f93dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:29.927575 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-fb5a65cb-795e-4107-9d15-7d3dd52f93dc service neutron] 10.222.0.16 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 916 time: 0.1441669
May 20 16:25:30.031980 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-2e034a4b-a231-4796-ac35-4ca181c51f74 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 1002 time: 0.0971999
May 20 16:25:30.094216 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-c03e4f49-21a9-4e0e-8fff-12f5c82024a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:30.095705 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-c03e4f49-21a9-4e0e-8fff-12f5c82024a4 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 200  len: 854 time: 0.0576236
May 20 16:25:30.176551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-61957d10-3684-47e2-a59d-eac163d5cdff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:30.178029 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-61957d10-3684-47e2-a59d-eac163d5cdff service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1c714e06-ccca-4a05-8bd6-477318017820&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0747132
May 20 16:25:30.398417 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-729d0f7f-f1e9-4492-bd90-1a272c96adc4 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2124071
May 20 16:25:30.527114 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0f2f6627-a402-4bd6-8d93-27d755d0e452 req-ae21e7cd-ee9d-4cea-8a0c-887cf80da3d1 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1218934
May 20 16:25:31.026611 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc34c2de-dd99-43ad-9d2b-cfed190cf9ce req-695393f2-f339-41e2-802f-968dec2d3012 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:31.028085 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dc34c2de-dd99-43ad-9d2b-cfed190cf9ce req-695393f2-f339-41e2-802f-968dec2d3012 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0789609
May 20 16:25:31.074643 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dc34c2de-dd99-43ad-9d2b-cfed190cf9ce req-3f36acc7-585b-4c4e-b9ed-5c1aca07c6e8 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0408447
May 20 16:25:31.635561 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e68c63-f6b9-4a34-98ee-2143c81e4c38 req-cd1dc5f6-966f-4844-93b7-42e5be90f035 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:31.637107 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a4e68c63-f6b9-4a34-98ee-2143c81e4c38 req-cd1dc5f6-966f-4844-93b7-42e5be90f035 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0840154
May 20 16:25:31.682532 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a4e68c63-f6b9-4a34-98ee-2143c81e4c38 req-f123dbb5-100d-4ead-996b-308c20b5c2bd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394943
May 20 16:25:32.266269 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb985436-f306-45ea-b20d-296e1e9d4d30 req-b9feb90d-ac45-452b-b0a9-926d1c17f77f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:32.267816 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cb985436-f306-45ea-b20d-296e1e9d4d30 req-b9feb90d-ac45-452b-b0a9-926d1c17f77f tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0812163
May 20 16:25:32.317442 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cb985436-f306-45ea-b20d-296e1e9d4d30 req-6542a670-9673-4596-a5d8-f6b6628f0834 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0438759
May 20 16:25:32.868180 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088c93aa-c364-477a-9601-58fc0a7140c6 req-bc03ca5c-1d7b-44bb-8cc6-085e9e4947bc tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:32.869542 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-088c93aa-c364-477a-9601-58fc0a7140c6 req-bc03ca5c-1d7b-44bb-8cc6-085e9e4947bc tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0792985
May 20 16:25:32.914497 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-088c93aa-c364-477a-9601-58fc0a7140c6 req-63f0952c-1c46-4721-aed2-7706dfc3ef5e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391951
May 20 16:25:32.962191 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:25:33.508600 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf8a2a5-b006-4dab-acf7-d6ddae2f7333 req-cda76cc0-1b01-42ea-aa3d-0ea0c79157a0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:33.509957 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-abf8a2a5-b006-4dab-acf7-d6ddae2f7333 req-cda76cc0-1b01-42ea-aa3d-0ea0c79157a0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0840058
May 20 16:25:33.555915 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-abf8a2a5-b006-4dab-acf7-d6ddae2f7333 req-2443f416-245f-4abb-a79b-dcaaca916715 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0400758
May 20 16:25:34.095134 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af99039b-a08a-42fe-b333-860a10897e57 req-0c62131f-967b-4064-ad96-12e6ccc5c0e8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:34.096597 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-af99039b-a08a-42fe-b333-860a10897e57 req-0c62131f-967b-4064-ad96-12e6ccc5c0e8 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0780325
May 20 16:25:34.139658 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-af99039b-a08a-42fe-b333-860a10897e57 req-0361c6f2-a290-498c-8c1c-ff0b029efc57 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0368831
May 20 16:25:34.742902 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5d2476-711e-4cad-b542-4d4c6cb2de3c req-70fb7d4d-8d3a-4d07-ab27-a2eaacf1be4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:34.744387 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f5d2476-711e-4cad-b542-4d4c6cb2de3c req-70fb7d4d-8d3a-4d07-ab27-a2eaacf1be4d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0839307
May 20 16:25:34.792604 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f5d2476-711e-4cad-b542-4d4c6cb2de3c req-b257b3df-2ba3-48ce-9461-38abf18bd881 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0423200
May 20 16:25:35.323766 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e758dd5e-d69b-41cf-b24b-0fba7e988f80 req-fdf41afa-10db-4c73-88aa-6908e7e7c3fa tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:35.325267 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e758dd5e-d69b-41cf-b24b-0fba7e988f80 req-fdf41afa-10db-4c73-88aa-6908e7e7c3fa tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0807650
May 20 16:25:35.374712 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e758dd5e-d69b-41cf-b24b-0fba7e988f80 req-11449b68-f050-47c9-b25e-dce12b0b73b1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436213
May 20 16:25:35.982593 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599ec103-db33-4424-b490-6096be716d01 req-17427740-33ad-4399-a05c-df9fdfab7466 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:35.984073 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-599ec103-db33-4424-b490-6096be716d01 req-17427740-33ad-4399-a05c-df9fdfab7466 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0798650
May 20 16:25:36.031137 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-599ec103-db33-4424-b490-6096be716d01 req-b636b76d-2bdf-4a80-ad9b-fe2af341d1a2 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0412300
May 20 16:25:36.562638 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4efb3c7-fce6-4978-9239-6d2115498486 req-804a7932-98be-4076-aaee-04be85265976 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:36.565844 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e4efb3c7-fce6-4978-9239-6d2115498486 req-804a7932-98be-4076-aaee-04be85265976 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0838969
May 20 16:25:36.612822 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e4efb3c7-fce6-4978-9239-6d2115498486 req-6fd37f8f-06f4-488d-9251-4537c1b0d405 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404694
May 20 16:25:37.220319 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ffbc39-bde8-4c7f-a219-60254604ed68 req-3b489225-b17b-4e44-aec0-db000c98d960 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:37.221758 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19ffbc39-bde8-4c7f-a219-60254604ed68 req-3b489225-b17b-4e44-aec0-db000c98d960 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0793817
May 20 16:25:37.268650 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19ffbc39-bde8-4c7f-a219-60254604ed68 req-a1c4b410-0c1b-465d-9e0e-5785c687cd31 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0409262
May 20 16:25:37.802562 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b815650-2d3d-4cda-8a60-ea23d4fb9906 req-22663c36-b496-4edb-967f-68ae610cab60 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:37.804036 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5b815650-2d3d-4cda-8a60-ea23d4fb9906 req-22663c36-b496-4edb-967f-68ae610cab60 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0842400
May 20 16:25:37.847727 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5b815650-2d3d-4cda-8a60-ea23d4fb9906 req-1820c659-4001-410d-90ca-80933606920d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379755
May 20 16:25:38.453535 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5573e025-30cf-4e55-a64e-b9c056acc734 req-1927f084-5441-4a13-a9a8-948649916c58 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:38.454896 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5573e025-30cf-4e55-a64e-b9c056acc734 req-1927f084-5441-4a13-a9a8-948649916c58 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0802376
May 20 16:25:38.505711 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5573e025-30cf-4e55-a64e-b9c056acc734 req-d87d91c5-5563-445a-a369-defe098f680b tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0449042
May 20 16:25:39.036047 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430b54f3-4859-457f-b81f-45b30d78e8a8 req-97dc56ff-eb82-4494-8487-88d8488fc7b3 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:39.037496 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-430b54f3-4859-457f-b81f-45b30d78e8a8 req-97dc56ff-eb82-4494-8487-88d8488fc7b3 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0816810
May 20 16:25:39.081602 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-430b54f3-4859-457f-b81f-45b30d78e8a8 req-e635a02e-b748-4f06-b35d-d170e2593f84 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0384264
May 20 16:25:39.695729 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14a0723-515c-47fc-944b-fc31ab7bc430 req-663cc602-926c-4c6c-8f5c-94ce5c3c2749 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:39.697172 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a14a0723-515c-47fc-944b-fc31ab7bc430 req-663cc602-926c-4c6c-8f5c-94ce5c3c2749 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0841613
May 20 16:25:39.744756 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a14a0723-515c-47fc-944b-fc31ab7bc430 req-e86b7ca5-3206-44f6-8031-845e1b86cd51 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0417466
May 20 16:25:40.264626 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7a18b9-1bfc-46fd-ba70-909f5dd8e2d0 req-e4592748-943f-4c3c-8849-572157565742 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:40.266122 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6a7a18b9-1bfc-46fd-ba70-909f5dd8e2d0 req-e4592748-943f-4c3c-8849-572157565742 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0793271
May 20 16:25:40.313986 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6a7a18b9-1bfc-46fd-ba70-909f5dd8e2d0 req-145579f0-c00f-4b59-96be-b3a84a622835 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421901
May 20 16:25:41.008301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5a08f5-5715-4de1-b5c2-1265a9aa0b6e req-5219cb52-2aaa-4058-ac15-c60f4d97a93c tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:41.014130 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0e5a08f5-5715-4de1-b5c2-1265a9aa0b6e req-5219cb52-2aaa-4058-ac15-c60f4d97a93c tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.1584804
May 20 16:25:41.062496 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0e5a08f5-5715-4de1-b5c2-1265a9aa0b6e req-68f0be38-6ae9-4140-ac39-05de8ddbd207 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0410752
May 20 16:25:41.502658 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ad3c41-fa03-4f64-9283-433805c0398e req-40c2f759-0e9c-4b56-b955-94e4c7f5fe13 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:41.504127 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52ad3c41-fa03-4f64-9283-433805c0398e req-40c2f759-0e9c-4b56-b955-94e4c7f5fe13 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0813675
May 20 16:25:41.549093 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-52ad3c41-fa03-4f64-9283-433805c0398e req-a2eed318-5cdc-436b-825f-e6fff8889c5d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391555
May 20 16:25:42.243620 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b02e4ce-714e-4ede-9800-7e10778ad8df req-84b6b239-d6dc-46e8-a186-3c04affdd432 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:42.245068 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b02e4ce-714e-4ede-9800-7e10778ad8df req-84b6b239-d6dc-46e8-a186-3c04affdd432 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0799975
May 20 16:25:42.294821 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b02e4ce-714e-4ede-9800-7e10778ad8df req-a1c9e6f8-9368-4c8d-ade6-cad304a838ef tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&id=a292603c-6418-4b1e-bfa7-3426b368cc59&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0439391
May 20 16:25:42.734788 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b528a0f6-b987-45eb-8871-88e4201017a2 req-f882c345-5bba-44b7-9974-b30b7721c594 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:42.736326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b528a0f6-b987-45eb-8871-88e4201017a2 req-f882c345-5bba-44b7-9974-b30b7721c594 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0808678
May 20 16:25:42.781647 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b528a0f6-b987-45eb-8871-88e4201017a2 req-91db12cf-a80c-46c0-a797-288302d0f670 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398028
May 20 16:25:43.245694 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9703e6-2543-4ec3-a9a3-e9849c00da04 req-ca58a00a-69c8-426f-81c7-025fd3faa824 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:43.247070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cd9703e6-2543-4ec3-a9a3-e9849c00da04 req-ca58a00a-69c8-426f-81c7-025fd3faa824 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0875924
May 20 16:25:43.293424 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cd9703e6-2543-4ec3-a9a3-e9849c00da04 req-c5ef70ca-a0cc-4597-94aa-8c03de6f0c64 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400400
May 20 16:25:43.362619 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-02d39d47-0b87-4161-aa24-07b5675650df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:43.364098 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-02d39d47-0b87-4161-aa24-07b5675650df service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 1098 time: 0.0698361
May 20 16:25:43.491920 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-3376c978-9dc4-4871-9acd-ce1a17073795 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:43.493338 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-3376c978-9dc4-4871-9acd-ce1a17073795 service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.1220779
May 20 16:25:43.592642 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-479eebe1-d9db-4986-8006-0ae7e4bea5b2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 200  len: 1001 time: 0.0928552
May 20 16:25:43.658672 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-121da81c-12fd-47a7-bcaf-09fdf76a13aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:43.660073 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-121da81c-12fd-47a7-bcaf-09fdf76a13aa service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.0586331
May 20 16:25:43.735075 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-8ff2aaa0-3832-4ebb-9bb8-1f42626980c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:43.736523 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-8ff2aaa0-3832-4ebb-9bb8-1f42626980c0 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0674701
May 20 16:25:43.867283 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-b648b725-95c8-4172-8c5f-463bdc70bf4d service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1234617
May 20 16:25:44.000613 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9fef4e3a-8aa5-4aef-80f8-8c6b1ee1abd5 req-256ecc75-4e89-4d92-a7b4-dcfe2ebf19a4 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1231000
May 20 16:25:44.475923 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4891227f-9676-424d-ad19-fe03e56de407 req-608d887b-4d27-42f7-aed0-28a7346a19e7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:44.477368 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4891227f-9676-424d-ad19-fe03e56de407 req-608d887b-4d27-42f7-aed0-28a7346a19e7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0783000
May 20 16:25:44.525818 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4891227f-9676-424d-ad19-fe03e56de407 req-e291ce7c-c025-40e0-8e20-14bdb4c50b7c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426099
May 20 16:25:45.706935 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-494b46fc-5733-4c1e-9acc-8cb7bac4f7e6 req-395fa42b-22a6-4a92-ad25-8cbbb85fc985 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:45.708383 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-494b46fc-5733-4c1e-9acc-8cb7bac4f7e6 req-395fa42b-22a6-4a92-ad25-8cbbb85fc985 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.0778630
May 20 16:25:45.751547 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-494b46fc-5733-4c1e-9acc-8cb7bac4f7e6 req-ab9606e4-4a22-4566-9180-89e7dee0383b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0369051
May 20 16:25:45.888704 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ec9dd16b-f128-4802-8330-87dd51911460 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:48.462106 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:48.667732 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9ccb680b-c595-45cf-99fb-257596e9cabf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:49.638948 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:51.317412 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:25:58.100592 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-d69ceb2d-9c72-4d38-bfea-856e0dad395c service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0712979
May 20 16:25:58.192146 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-4517dba4-b4a6-4cf0-ae40-b2676b4f08d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:58.194274 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-4517dba4-b4a6-4cf0-ae40-b2676b4f08d9 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1098 time: 0.0688248
May 20 16:25:58.415137 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-3fd82d3e-0880-497b-9bec-5d718b8e2398 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:58.416594 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-3fd82d3e-0880-497b-9bec-5d718b8e2398 service neutron] 10.222.0.16 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 910 time: 0.2014258
May 20 16:25:58.520156 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-b453b662-dc1d-49c5-8a93-f002508e500e service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 1001 time: 0.0959494
May 20 16:25:58.596432 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-0044dba9-7ac5-439b-be21-cce27e260c1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:58.597840 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-0044dba9-7ac5-439b-be21-cce27e260c1e service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 200  len: 848 time: 0.0606561
May 20 16:25:58.673826 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-9c9b25e7-51d6-4c73-9c90-d50663ad0baa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:25:58.675206 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-9c9b25e7-51d6-4c73-9c90-d50663ad0baa service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=39834042-f759-400b-9bc0-eb7c7abdd5c0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0695114
May 20 16:25:58.806020 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-06012417-7a79-4e5d-837c-83686e91df7c service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1224191
May 20 16:25:58.935462 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a9d8da-7f3a-4257-8f6f-65c4f30c0251 req-6f18b13b-cf76-41f8-b755-486ab4615d2a service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1217067
May 20 16:25:59.334255 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:09.961190 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:26:15.906997 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7f7248d4-18af-41a5-b097-c035c63c53e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:16.763755 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8eb5bd-06d4-43a2-9c51-8aaca7927a4c req-cafba67d-d813-4098-aad4-0035e838e838 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:16.765195 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9b8eb5bd-06d4-43a2-9c51-8aaca7927a4c req-cafba67d-d813-4098-aad4-0035e838e838 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0809467
May 20 16:26:16.812665 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9b8eb5bd-06d4-43a2-9c51-8aaca7927a4c req-0a1c2db0-a8d8-4930-8a1c-92e50b7ce239 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416970
May 20 16:26:18.001606 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06390cbd-320e-4051-9ed2-7741ca149b1c req-e37b09ee-044e-4869-be4d-f72855eb7802 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:18.003260 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-06390cbd-320e-4051-9ed2-7741ca149b1c req-e37b09ee-044e-4869-be4d-f72855eb7802 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0804493
May 20 16:26:18.047782 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-06390cbd-320e-4051-9ed2-7741ca149b1c req-b7b06630-2e62-4c35-bdb3-9b8055bb41c8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383861
May 20 16:26:18.443503 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:18.649486 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-62a70f55-370a-4ff7-8195-527b9110529a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:19.238991 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51f40bc-c9d5-47b8-b2e4-c47b605cb3da req-db544f3f-d780-40ea-84a8-80a0b0509f78 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:19.240463 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a51f40bc-c9d5-47b8-b2e4-c47b605cb3da req-db544f3f-d780-40ea-84a8-80a0b0509f78 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0833991
May 20 16:26:19.285074 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a51f40bc-c9d5-47b8-b2e4-c47b605cb3da req-7a51922c-f842-466e-a9a2-1cb968056055 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386989
May 20 16:26:19.654989 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:20.474014 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ba8291-7bd0-4adf-8854-d16e28d940d4 req-403437cb-5110-42b4-ab36-400a175cf491 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:20.476060 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-57ba8291-7bd0-4adf-8854-d16e28d940d4 req-403437cb-5110-42b4-ab36-400a175cf491 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0779901
May 20 16:26:20.518450 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-57ba8291-7bd0-4adf-8854-d16e28d940d4 req-690cd11c-1d51-43a0-9f3c-2f4145c9272b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0364728
May 20 16:26:21.289597 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:21.712486 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d82aaef-987d-4448-ada4-f4c604f839c9 req-4ec15925-f494-40a3-8f01-63643205d5e5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:21.713923 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4d82aaef-987d-4448-ada4-f4c604f839c9 req-4ec15925-f494-40a3-8f01-63643205d5e5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0821297
May 20 16:26:21.758537 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4d82aaef-987d-4448-ada4-f4c604f839c9 req-2df36176-2287-4248-8d91-f49999118f1c tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388253
May 20 16:26:22.946224 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3197a7-78f5-4a16-9530-65850d3b06f8 req-a010033c-8c74-4303-b62f-533fa296cb40 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:22.947674 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f3197a7-78f5-4a16-9530-65850d3b06f8 req-a010033c-8c74-4303-b62f-533fa296cb40 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0807533
May 20 16:26:22.995177 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f3197a7-78f5-4a16-9530-65850d3b06f8 req-929f0438-8937-43c5-b421-d911b83b77d9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417874
May 20 16:26:24.182274 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2e9c00a-fc79-47fa-a7d9-a62001e4272f req-f72656e6-7b86-4354-a6ad-de421af39b0f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:24.183725 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2e9c00a-fc79-47fa-a7d9-a62001e4272f req-f72656e6-7b86-4354-a6ad-de421af39b0f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0793402
May 20 16:26:24.228193 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f2e9c00a-fc79-47fa-a7d9-a62001e4272f req-b398a774-95ad-4183-a773-b130a9786818 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387342
May 20 16:26:25.416060 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d262480a-cefd-4c77-8035-9ed1b118ed41 req-d1dd35e9-3101-4fc3-94b8-9b48a2fa440a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:25.417473 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d262480a-cefd-4c77-8035-9ed1b118ed41 req-d1dd35e9-3101-4fc3-94b8-9b48a2fa440a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0814414
May 20 16:26:25.459937 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d262480a-cefd-4c77-8035-9ed1b118ed41 req-a2c16360-ae38-4478-bf33-91cd6cf7d5cf tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0369000
May 20 16:26:26.647348 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80cac4-574c-4750-816a-9f2284857180 req-3788b328-b828-4004-928f-1f84fa756560 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:26.648823 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cf80cac4-574c-4750-816a-9f2284857180 req-3788b328-b828-4004-928f-1f84fa756560 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0807371
May 20 16:26:26.693218 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cf80cac4-574c-4750-816a-9f2284857180 req-64211e95-e2dc-45d0-a76e-86c17b3e62ac tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384200
May 20 16:26:27.893759 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ec016f-e772-4fc8-9239-20a9cf6dd4e2 req-016d4692-f38c-4d3e-9605-0a166f147e55 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:27.895111 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4ec016f-e772-4fc8-9239-20a9cf6dd4e2 req-016d4692-f38c-4d3e-9605-0a166f147e55 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0833273
May 20 16:26:27.937881 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4ec016f-e772-4fc8-9239-20a9cf6dd4e2 req-e8aad852-8b03-4ee5-beb8-6086d2db52e5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0370212
May 20 16:26:28.931630 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:26:29.066172 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:26:29.079057 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '224f3f0d-380f-45af-8889-4430982438fe', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'port_id': '224f3f0d-380f-45af-8889-4430982438fe', 'mac_address': 'fa:16:3e:5a:5b:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:26:29.132680 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301267f1-e5d6-4470-aae1-f22dd095b764 req-949b851d-af04-4586-9438-d09bcea8adef tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:29.133631 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:29.134218 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301267f1-e5d6-4470-aae1-f22dd095b764 req-949b851d-af04-4586-9438-d09bcea8adef tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0812383
May 20 16:26:29.153451 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 224f3f0d-380f-45af-8889-4430982438fe {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:26:29.169007 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:26:29.187062 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-301267f1-e5d6-4470-aae1-f22dd095b764 req-1cd922fa-6771-4750-abd7-661907a249e3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425551
May 20 16:26:29.329364 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:29.334116 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:26:29.399383 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=6']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:26:29.406687 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.407032 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.407393 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.407725 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.408048 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.408372 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.408693 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.409010 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.409329 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.409646 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.409964 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.410278 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:29.413953 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:26:29.415612 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:29.437216 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['224f3f0d-380f-45af-8889-4430982438fe'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:26:30.447844 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681e3644-fef8-43e4-bdb6-5fd06d26e436 req-0a521cce-a3ed-45f2-9c9f-d2ae937f2c02 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:30.449303 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-681e3644-fef8-43e4-bdb6-5fd06d26e436 req-0a521cce-a3ed-45f2-9c9f-d2ae937f2c02 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 944 time: 0.1575935
May 20 16:26:30.493188 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-681e3644-fef8-43e4-bdb6-5fd06d26e436 req-0f7cf388-a0d5-49a1-868f-04d5f003facf tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381074
May 20 16:26:30.937655 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:26:31.003946 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 224f3f0d-380f-45af-8889-4430982438fe triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:26:31.004321 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:31.117401 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:31.146351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:26:31.156069 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:26:31.195531 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe', 'code': 200}
May 20 16:26:31.312199 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:31.314868 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:26:31.383252 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=7']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:26:31.386454 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:26:31.680962 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f729f1-0707-46c6-8a4e-e401e13b08f1 req-140a26c0-9e16-4ae5-8b23-2d1d36bad1aa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:31.682387 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4f729f1-0707-46c6-8a4e-e401e13b08f1 req-140a26c0-9e16-4ae5-8b23-2d1d36bad1aa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0818191
May 20 16:26:31.726352 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f4f729f1-0707-46c6-8a4e-e401e13b08f1 req-cb9882e4-07af-486f-92c8-268858735784 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383525
May 20 16:26:32.915896 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40cf356-bf6d-43c0-a887-7e3cb502b022 req-7bdf9de7-b5d5-40c6-8a33-d65b82104024 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:32.917376 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b40cf356-bf6d-43c0-a887-7e3cb502b022 req-7bdf9de7-b5d5-40c6-8a33-d65b82104024 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0806923
May 20 16:26:32.963840 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b40cf356-bf6d-43c0-a887-7e3cb502b022 req-04d5dfb1-d939-4f51-a465-988665cf29b3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401988
May 20 16:26:34.154235 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ff745d-81a4-47fc-94b5-832bd61bcbf1 req-b64b73a2-8280-4b61-91cf-f99406cc8951 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:34.155836 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a4ff745d-81a4-47fc-94b5-832bd61bcbf1 req-b64b73a2-8280-4b61-91cf-f99406cc8951 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0810702
May 20 16:26:34.200619 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a4ff745d-81a4-47fc-94b5-832bd61bcbf1 req-8418cf93-f05c-47f0-940c-e5e6c37547b4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391221
May 20 16:26:35.396157 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70602083-2c80-48b4-8591-9e4672d2184a req-032c72a7-8669-460d-8df9-e5b7b840c5f1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:35.397627 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-70602083-2c80-48b4-8591-9e4672d2184a req-032c72a7-8669-460d-8df9-e5b7b840c5f1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0862730
May 20 16:26:35.442383 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-70602083-2c80-48b4-8591-9e4672d2184a req-3ca4f307-a78c-46f3-8468-149148819818 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386765
May 20 16:26:36.706028 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870d8d61-642e-4f27-81e3-60ae12bc4bdf req-8938b980-2aad-454d-82a0-f223e2922056 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:36.707520 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-870d8d61-642e-4f27-81e3-60ae12bc4bdf req-8938b980-2aad-454d-82a0-f223e2922056 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.1412098
May 20 16:26:36.758328 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-870d8d61-642e-4f27-81e3-60ae12bc4bdf req-3546da11-ea2d-4f98-a139-ee638dab04c5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449975
May 20 16:26:38.035476 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f527a73-3ebd-4e5b-a4f9-068ba3307d17 req-a8374699-6f46-43f7-bfc1-299bff13917e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:38.037773 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2f527a73-3ebd-4e5b-a4f9-068ba3307d17 req-a8374699-6f46-43f7-bfc1-299bff13917e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.1515813
May 20 16:26:38.087517 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2f527a73-3ebd-4e5b-a4f9-068ba3307d17 req-25c3a45d-9854-4a6b-a52a-418c813c3879 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406535
May 20 16:26:39.312679 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcb92d5-702f-4755-b38f-781d0cbc7efa req-5f02f33b-e2d6-488e-bdab-f0019f5677c5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:39.315024 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-abcb92d5-702f-4755-b38f-781d0cbc7efa req-5f02f33b-e2d6-488e-bdab-f0019f5677c5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.1083422
May 20 16:26:39.375114 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-abcb92d5-702f-4755-b38f-781d0cbc7efa req-b30f223f-3260-457b-aeb5-5b9202c1588f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0527260
May 20 16:26:40.574481 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0613436d-5982-43a4-8108-c6d709c8022d req-5f322b7e-4772-4e67-b895-04628ad097af tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:40.581834 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0613436d-5982-43a4-8108-c6d709c8022d req-5f322b7e-4772-4e67-b895-04628ad097af tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0896573
May 20 16:26:40.627172 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0613436d-5982-43a4-8108-c6d709c8022d req-474aae88-b754-4a8a-a243-649b72af8d44 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0444186
May 20 16:26:41.833187 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0029672f-09a6-4c47-9053-def39232b99a req-5357c04d-c433-43fc-a4ca-63c1944d710e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:41.834963 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0029672f-09a6-4c47-9053-def39232b99a req-5357c04d-c433-43fc-a4ca-63c1944d710e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0926178
May 20 16:26:41.882892 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0029672f-09a6-4c47-9053-def39232b99a req-437d9cae-4048-4cfe-aa8f-a2f1d5905509 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416400
May 20 16:26:43.101562 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba8507e-ed3d-49b2-9c6d-60f7ee14ade8 req-76e66aee-7368-4c3f-bff2-dcc74f8c0267 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:43.103270 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dba8507e-ed3d-49b2-9c6d-60f7ee14ade8 req-76e66aee-7368-4c3f-bff2-dcc74f8c0267 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0880423
May 20 16:26:43.156525 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dba8507e-ed3d-49b2-9c6d-60f7ee14ade8 req-b6bf02ce-edb3-40e8-bb24-9db8f118bdae tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0447810
May 20 16:26:44.348097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7edf86de-1964-4081-b5b3-dfdd39abd72c req-6e30e70f-7d88-47a3-9114-0ec8a13feb79 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:44.349479 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7edf86de-1964-4081-b5b3-dfdd39abd72c req-6e30e70f-7d88-47a3-9114-0ec8a13feb79 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0784569
May 20 16:26:44.400003 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7edf86de-1964-4081-b5b3-dfdd39abd72c req-91316489-86bf-43ae-8f50-d997e78199f5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424345
May 20 16:26:45.605034 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08f48da-2dcd-4d23-95d5-d1fe3c98ac70 req-8f55c5be-9099-4c78-a724-9c77cc31396a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:45.606915 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e08f48da-2dcd-4d23-95d5-d1fe3c98ac70 req-8f55c5be-9099-4c78-a724-9c77cc31396a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0894656
May 20 16:26:45.663486 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e08f48da-2dcd-4d23-95d5-d1fe3c98ac70 req-b43a4977-fd99-4f30-beaf-dc5c041e74f9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449388
May 20 16:26:46.466172 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7b12d9e0-a663-49ab-8d2e-e0deb583aea6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:46.883093 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b47da03-a26e-4da3-8b5b-3c6a125f8250 req-59270238-1783-4149-8aa1-ae8c2bb231db tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:46.884686 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b47da03-a26e-4da3-8b5b-3c6a125f8250 req-59270238-1783-4149-8aa1-ae8c2bb231db tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0883501
May 20 16:26:46.934124 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b47da03-a26e-4da3-8b5b-3c6a125f8250 req-3f93b61a-7364-45fa-aac6-b210c53e5f3d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405281
May 20 16:26:46.960221 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:26:48.130006 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a827257-3c6f-4596-a17f-383967704b99 req-7c94a32e-a218-4ba1-aeab-7b14bb1bd4c8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:48.131414 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3a827257-3c6f-4596-a17f-383967704b99 req-7c94a32e-a218-4ba1-aeab-7b14bb1bd4c8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0832229
May 20 16:26:48.176549 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3a827257-3c6f-4596-a17f-383967704b99 req-a3a33789-ad1c-40f2-8678-11e67db9979a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395215
May 20 16:26:48.448525 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:48.682807 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6b743b32-209b-4613-8315-d70675ec6a3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:48.819297 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-9f5b48c4-93e5-4184-a0bc-74ebaa28417c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:48.820758 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-9f5b48c4-93e5-4184-a0bc-74ebaa28417c service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1098 time: 0.0695529
May 20 16:26:48.952316 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-de9f52f9-32a7-464b-9856-47022ec10a2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:48.956200 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-de9f52f9-32a7-464b-9856-47022ec10a2f service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1258926
May 20 16:26:49.133103 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-da1d6c39-92f0-4116-a57d-b78410bf6541 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=224f3f0d-380f-45af-8889-4430982438fe HTTP/1.1" status: 200  len: 1000 time: 0.1717680
May 20 16:26:49.197146 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-1bb02093-7ba4-43a6-8e38-a4c590ee8600 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:49.198598 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-1bb02093-7ba4-43a6-8e38-a4c590ee8600 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0593212
May 20 16:26:49.274186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-1ebe6f83-6e0f-444b-8110-c59982b27593 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:49.275820 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-1ebe6f83-6e0f-444b-8110-c59982b27593 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0709946
May 20 16:26:49.465235 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-06147feb-7f78-47cc-8c70-042d5353640e service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1819258
May 20 16:26:49.475775 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71faf743-6867-4bcb-95cd-7100337cb942 req-f669dc97-100e-4ed1-93d3-996c41d74456 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:49.477137 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-71faf743-6867-4bcb-95cd-7100337cb942 req-f669dc97-100e-4ed1-93d3-996c41d74456 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.1759672
May 20 16:26:49.605410 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-71faf743-6867-4bcb-95cd-7100337cb942 req-c9234c93-5c3d-4fb8-adbb-69ae4cef2c47 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1099222
May 20 16:26:49.632580 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:49.636295 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7ebf91ba-5c94-49c6-8698-7b37dde2560c req-eca9f116-9d32-4693-b28d-fff3f2ca4184 service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1582329
May 20 16:26:50.792414 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad2415b-f201-4ab5-9758-9322ea3bd6d5 req-3bdbb6be-412c-4fe1-928d-707e0680e175 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:50.793897 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ad2415b-f201-4ab5-9758-9322ea3bd6d5 req-3bdbb6be-412c-4fe1-928d-707e0680e175 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 945 time: 0.0790195
May 20 16:26:50.841513 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ad2415b-f201-4ab5-9758-9322ea3bd6d5 req-d6b5b69c-aad4-49a4-b6f4-5ad162f4e304 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419564
May 20 16:26:51.002976 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:26:51.112155 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:51.141521 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:26:51.151243 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:26:51.243288 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:51.245173 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-f25fd3e3-8772-4cd2-ae9d-8b408ca3d23d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:26:51.315358 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=8']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:26:51.318685 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:26:51.328695 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe', 'code': 200}
May 20 16:26:51.351150 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:52.029327 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449ae0ee-4e74-43b9-930a-e536487696ad req-fcca72c9-96cb-42d1-9c27-7021e51346e0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:52.030767 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-449ae0ee-4e74-43b9-930a-e536487696ad req-fcca72c9-96cb-42d1-9c27-7021e51346e0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0785728
May 20 16:26:52.073821 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-449ae0ee-4e74-43b9-930a-e536487696ad req-0ca79411-4d4c-4fb4-8344-eaf4bf63e969 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0373919
May 20 16:26:54.134549 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-62adc286-17dc-4a8f-9834-a4eda1b8a244 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1358111619&fields=id&tenant_id=8614158322ae423bb16b1c0645c66cf9 HTTP/1.1" status: 200  len: 267 time: 0.0446084
May 20 16:26:54.218842 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-fb29c840-ee1a-42ff-9775-2f69528c2c72 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:54.220360 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-fb29c840-ee1a-42ff-9775-2f69528c2c72 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 985 time: 0.0803008
May 20 16:26:54.231976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Request body: {'port': {'security_groups': ['62841583-ef69-4bd6-9ba1-a6118731c4d9']}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:26:54.352092 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:54.649055 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a7e868-3e49-4e5a-b30f-1f05750b8a10 req-40fe9e15-5e1d-437c-9588-cab4e1ef802d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:54.650505 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e1a7e868-3e49-4e5a-b30f-1f05750b8a10 req-40fe9e15-5e1d-437c-9588-cab4e1ef802d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.2012179
May 20 16:26:54.658849 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=16ee028f-977c-4c03-a101-a688c6953d30,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:26:54.712340 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e1a7e868-3e49-4e5a-b30f-1f05750b8a10 req-2d21f99b-c20c-41c7-ab19-53ae689eddd5 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0558467
May 20 16:26:54.716267 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:54.791799 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:54.798381 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:26:54.811918 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['16ee028f-977c-4c03-a101-a688c6953d30'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:26:54.866490 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:54.867123 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:54.868543 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9729972b-ad74-47f9-9732-6cae3e39c58d req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "PUT /v2.0/ports/16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 943 time: 0.6413026
May 20 16:26:54.869169 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:26:54.875011 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38212) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:26:54.901951 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event updated for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=7']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:26:54.925877 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.926682 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.926682 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.926963 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.927349 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.927711 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.928192 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.928550 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.928900 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.929248 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.929601 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.929949 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:54.934796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:26:54.948132 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30', 'status': 'completed', 'code': 200}
May 20 16:26:54.983558 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:55.019604 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:26:55.032423 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:55.061669 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['16ee028f-977c-4c03-a101-a688c6953d30'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:26:55.157447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:55.164071 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4371d528-89f1-4834-97a3-e82b60f62c88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:26:55.184253 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a292603c-6418-4b1e-bfa7-3426b368cc59,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:26:55.191151 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24430490-e61f-4785-a1da-633cd723a080 req-197a009e-bc3e-46a0-aacc-6601d0d4612d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:55.192630 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-197a009e-bc3e-46a0-aacc-6601d0d4612d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1099 time: 0.2220778
May 20 16:26:55.194721 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:55.196367 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "DELETE /v2.0/security-groups/a292603c-6418-4b1e-bfa7-3426b368cc59 HTTP/1.1" status: 204  len: 168 time: 0.3200862
May 20 16:26:55.197931 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.198358 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.198780 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.199292 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.199821 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.200284 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.200707 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.201504 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.201940 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.202357 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.202777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.204100 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:26:55.207059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38226) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:26:55.352307 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-ffe1a23d-b136-4b35-bd35-14c39635f4e2 None None] Provisioning complete for port 16ee028f-977c-4c03-a101-a688c6953d30 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:26:55.352745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ffe1a23d-b136-4b35-bd35-14c39635f4e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:55.388676 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:26:55.532414 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24430490-e61f-4785-a1da-633cd723a080 req-d65c43c3-4f27-4af5-baf0-11a600383c32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:55.533874 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-d65c43c3-4f27-4af5-baf0-11a600383c32 service neutron] 10.222.0.16 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 916 time: 0.3330824
May 20 16:26:55.541467 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d27c99-b8af-4ae3-8d5c-9f0144045b38 req-4dce880b-f557-48d5-803e-09cd17184b67 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:55.542867 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07d27c99-b8af-4ae3-8d5c-9f0144045b38 req-4dce880b-f557-48d5-803e-09cd17184b67 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.3034434
May 20 16:26:55.652896 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93398220-9171-4e51-b0a3-1e971eea232a req-cf722e38-920d-4279-b126-a77400aaf1c2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:55.653580 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-93398220-9171-4e51-b0a3-1e971eea232a req-cf722e38-920d-4279-b126-a77400aaf1c2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Synchronizing usage tracker for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:26:55.663966 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-4b5cbd93-ee01-4c6f-9ae1-ac7e90a40c3b service neutron] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.2236512
May 20 16:26:55.673219 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07d27c99-b8af-4ae3-8d5c-9f0144045b38 req-9b9c89f9-d114-49b8-8dff-3e1ab2c10d28 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0767708
May 20 16:26:55.675116 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-c0bdc97b-7a27-4c66-bad2-3b7d22f469e7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 1002 time: 0.1312711
May 20 16:26:55.741403 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24430490-e61f-4785-a1da-633cd723a080 req-e46415d5-c479-4260-872a-561274d3fb31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:55.743130 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-e46415d5-c479-4260-872a-561274d3fb31 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 200  len: 854 time: 0.0616291
May 20 16:26:55.749753 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Deleting port 53980d5a-088a-4af2-a668-227a5ba9a412 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:26:55.754642 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:55.822423 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24430490-e61f-4785-a1da-633cd723a080 req-43e09a49-f9d2-4a81-ae49-cfa21943efa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:55.824199 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-43e09a49-f9d2-4a81-ae49-cfa21943efa9 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1c714e06-ccca-4a05-8bd6-477318017820&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0746610
May 20 16:26:55.874252 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-89028f53-80fd-4e5a-b5df-3ae080cff4d3 service neutron] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:26:55.875256 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-89028f53-80fd-4e5a-b5df-3ae080cff4d3 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0105803
May 20 16:26:55.888026 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:55.888604 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:56.008697 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-93398220-9171-4e51-b0a3-1e971eea232a req-cf722e38-920d-4279-b126-a77400aaf1c2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Unset dirty status for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:26:56.009888 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-93398220-9171-4e51-b0a3-1e971eea232a req-cf722e38-920d-4279-b126-a77400aaf1c2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.6187444
May 20 16:26:56.016861 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Calling delete_port for 53980d5a-088a-4af2-a668-227a5ba9a412 owned by network:floatingip {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:26:56.028406 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a6d576-d3a5-40e1-91e8-1baabe300a0d req-9ab17a29-3555-4000-b21c-afe0d69a82e6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:56.031064 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6a6d576-d3a5-40e1-91e8-1baabe300a0d req-9ab17a29-3555-4000-b21c-afe0d69a82e6 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.2022054
May 20 16:26:56.038785 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-df69a5e6-407a-45da-acc1-95fa771588e0 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1566665
May 20 16:26:56.166845 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c6a6d576-d3a5-40e1-91e8-1baabe300a0d req-d88f89ce-a8e2-4ac5-b880-714bb4a4bcfa tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1269948
May 20 16:26:56.191170 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Deleting port c643d109-2850-418c-806a-4eefcbdcc081 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:26:56.191562 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:56.216155 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-24430490-e61f-4785-a1da-633cd723a080 req-5959fc7c-6b06-4ecc-8186-4a6f9860c373 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1600099
May 20 16:26:56.371971 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] For port c643d109-2850-418c-806a-4eefcbdcc081, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=c643d109-2850-418c-806a-4eefcbdcc081,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:26:56.372326 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:56.449957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:56.455868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-61bd4355-ce78-4255-ba19-10d12ae1c52c tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:26:56.510795 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event deleted for resources: {'Port': ['ID=53980d5a-088a-4af2-a668-227a5ba9a412,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:26:56.547554 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:26:56.757736 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks [] for floatingip, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:56.758118 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Floating IP 3fc22b9e-088c-47fe-823b-0597ad6069f6 disassociated (deleted). External IP: 172.27.0.166, port: 16ee028f-977c-4c03-a101-a688c6953d30.
May 20 16:26:56.875980 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cba8157-428b-43fe-9e28-b56d4d35d83a req-3d8d2403-eeab-4d2b-ad9d-01a63339e036 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:56.879637 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5cba8157-428b-43fe-9e28-b56d4d35d83a req-3d8d2403-eeab-4d2b-ad9d-01a63339e036 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0941961
May 20 16:26:56.922187 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5cba8157-428b-43fe-9e28-b56d4d35d83a req-1bc90f86-d92b-4de3-bb7c-241390ba71e8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390561
May 20 16:26:56.964281 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:56.964806 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:56.964912 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Floating IP 0c7ce331-86f1-4fc2-8c6b-06391e928dca disassociated. External IP: 172.27.0.211, port: c643d109-2850-418c-806a-4eefcbdcc081.
May 20 16:26:56.965204 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Calling delete_port for c643d109-2850-418c-806a-4eefcbdcc081 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:26:57.227656 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-2dd9a391-c2ed-49ed-8159-af7f6b9453f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:57.229165 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-2dd9a391-c2ed-49ed-8159-af7f6b9453f1 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a&tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984 HTTP/1.1" status: 200  len: 1096 time: 0.0737278
May 20 16:26:57.309913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Router 611172fd-bcae-4d71-9f24-054476247eea has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:26:57.370758 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:57.383051 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:26:57.387359 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-4ce78e1e-42e6-4bfd-ad66-c1f5b5dafb54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:57.389404 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-4ce78e1e-42e6-4bfd-ad66-c1f5b5dafb54 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1096 time: 0.1372318
May 20 16:26:57.399548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f202d61-49f6-4cea-bac4-0a311a92cf9b req-eba6e5d4-c079-4e04-bad8-62a1c3974b4e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:57.400963 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f202d61-49f6-4cea-bac4-0a311a92cf9b req-eba6e5d4-c079-4e04-bad8-62a1c3974b4e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 945 time: 0.1124237
May 20 16:26:57.443927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event deleted for resources: {'Port': ['ID=c643d109-2850-418c-806a-4eefcbdcc081,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:26:57.452207 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:26:57.535860 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8f202d61-49f6-4cea-bac4-0a311a92cf9b req-680260f9-545d-483e-8788-aa14940cf6eb tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=139f796a-28b7-43ee-8acc-f0f1e38ad622&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1139839
May 20 16:26:57.567715 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-b54eb72b-0325-4b99-acdf-cd0e23decca3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:57.569283 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-b54eb72b-0325-4b99-acdf-cd0e23decca3 service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1674736
May 20 16:26:57.673221 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-c5e1bcbb-c7a4-4313-ac3a-a356d01a6f39 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=224f3f0d-380f-45af-8889-4430982438fe HTTP/1.1" status: 200  len: 998 time: 0.0973291
May 20 16:26:57.683168 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:26:57.694632 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-080734a3-81de-4169-aa69-970340806f6d None None] Sync routers for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:26:57.705075 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:26:57.705949 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712f16ca0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:26:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:57.719443 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:57.742161 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-4fb2151f-894b-4181-8e18-f60a56c3db25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:57.743628 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-4fb2151f-894b-4181-8e18-f60a56c3db25 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0637884
May 20 16:26:57.746695 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Router 27c15c4b-53de-4418-8ed7-78ad6d465033 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:26:57.829288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-b62b5e81-190d-411f-9a8d-6c31b79b9c94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:57.831326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-b62b5e81-190d-411f-9a8d-6c31b79b9c94 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0813265
May 20 16:26:57.849933 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "DELETE /v2.0/floatingips/3fc22b9e-088c-47fe-823b-0597ad6069f6 HTTP/1.1" status: 204  len: 168 time: 2.6416214
May 20 16:26:57.852476 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:26:57.948725 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30', 'status': 'completed', 'code': 200}
May 20 16:26:57.965252 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:26:58.045281 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:26:58.054874 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] Sync routers for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:26:58.093472 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:26:58.094203 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7129e8be0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:26:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:58.141228 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] No DVR routers for this DVR port c643d109-2850-418c-806a-4eefcbdcc081 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:26:58.144623 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:58.146592 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-93398220-9171-4e51-b0a3-1e971eea232a req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "DELETE /v2.0/ports/c643d109-2850-418c-806a-4eefcbdcc081 HTTP/1.1" status: 204  len: 173 time: 2.1251318
May 20 16:26:58.159836 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddca40f6-211e-427c-8024-499d343fc113 req-04c421ef-9a14-410d-a62b-0fafead0869e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:58.161429 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ddca40f6-211e-427c-8024-499d343fc113 req-04c421ef-9a14-410d-a62b-0fafead0869e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1099 time: 0.1835737
May 20 16:26:58.170739 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-4a0a0a3b-d897-4c41-b7b7-c59065f4ceaa service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3325937
May 20 16:26:58.419258 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712f16ca0>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:59Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:58.429276 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddca40f6-211e-427c-8024-499d343fc113 req-998196eb-9a3d-4afd-ae03-3bcf4b9f1073 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:58.430832 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ddca40f6-211e-427c-8024-499d343fc113 req-998196eb-9a3d-4afd-ae03-3bcf4b9f1073 service neutron] 10.222.0.16 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 916 time: 0.2630143
May 20 16:26:58.431725 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-080734a3-81de-4169-aa69-970340806f6d None None] Checking router: 611172fd-bcae-4d71-9f24-054476247eea for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:26:58.442712 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:26:58.443460 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712f16ca0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:26:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:58.450526 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:26:58.519854 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ddca40f6-211e-427c-8024-499d343fc113 req-56158dfd-5532-402f-87f6-454fdfa0846d service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 217 time: 0.0821276
May 20 16:26:58.550362 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16546ffd-2931-4431-8acd-e2aff0a847f9 req-43d01496-9e57-4585-891f-163c988d80fb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:58.557654 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-16546ffd-2931-4431-8acd-e2aff0a847f9 req-43d01496-9e57-4585-891f-163c988d80fb tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.3451705
May 20 16:26:58.588646 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d785ba7f-af34-436a-a57e-523f835bf6d9 req-7ea05f51-cf53-4da2-bdff-f5288ea9df0d service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4110258
May 20 16:26:58.613849 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-16546ffd-2931-4431-8acd-e2aff0a847f9 req-b349effd-0aa4-4f7f-879b-2812273977de tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0551519
May 20 16:26:58.635063 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddca40f6-211e-427c-8024-499d343fc113 req-ed566409-d7b8-4566-8873-0e6f72385c86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:58.635063 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ddca40f6-211e-427c-8024-499d343fc113 req-ed566409-d7b8-4566-8873-0e6f72385c86 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 200  len: 854 time: 0.0996394
May 20 16:26:58.653183 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:26:58.751909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddca40f6-211e-427c-8024-499d343fc113 req-49e38dd1-dec4-4a40-9104-6bed9b3ea32a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:58.756381 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ddca40f6-211e-427c-8024-499d343fc113 req-49e38dd1-dec4-4a40-9104-6bed9b3ea32a service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1c714e06-ccca-4a05-8bd6-477318017820&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1168883
May 20 16:26:58.868354 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-06e62519-c6d4-4dcf-820b-02702177473b req-9c73c468-cfe9-4c42-a216-ac1d4035dfe0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=d419699d-6355-4177-82f9-39936e18d34c HTTP/1.1" status: 200  len: 210 time: 0.0910928
May 20 16:26:58.918454 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7129e8be0>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:58.923220 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] Checking router: 27c15c4b-53de-4418-8ed7-78ad6d465033 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:26:58.931405 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:26:58.932234 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7129e8be0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:26:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:58.963293 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ddca40f6-211e-427c-8024-499d343fc113 req-2e545774-f905-4c3d-88e8-dfacd7ad2699 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1966925
May 20 16:26:59.047473 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device c643d109-2850-418c-806a-4eefcbdcc081 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:26:59.095020 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: c643d109-2850-418c-806a-4eefcbdcc081 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:26:59.095499 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device c643d109-2850-418c-806a-4eefcbdcc081 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:26:59.119020 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-080734a3-81de-4169-aa69-970340806f6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712f16ca0>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:59Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:59.123920 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-080734a3-81de-4169-aa69-970340806f6d None None] The sync data for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi is: [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:53Z', 'revision_number': 4, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '5eb209a1-6f70-43b5-b05d-364af120a723', 'name': '', 'network_id': '1c714e06-ccca-4a05-8bd6-477318017820', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'mac_address': 'fa:16:3e:08:6a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:53Z', 'updated_at': '2021-05-20T16:22:59Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'subnets': [{'id': '227d5494-8b2f-4a70-9e77-58d4d0e45746', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:26:59.137344 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:26:59.242998 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-ddca40f6-211e-427c-8024-499d343fc113 req-831c7cb8-e467-4f2d-b391-5e040a91da83 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2102082
May 20 16:26:59.340027 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:26:59.517326 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-807110a6-1457-4fe4-a07f-24dfd7e233ae None None] New status for floating IP 3fc22b9e-088c-47fe-823b-0597ad6069f6: DOWN {{(pid=92423) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:26:59.575227 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7129e8be0>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:26:59.580486 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da1c9b5f-354f-4240-8fe0-0ea45ebf83fd None None] The sync data for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi is: [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:26:59.907716 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6273482d-fabb-4f1c-9fce-4767f4e7b44b req-9175890a-c628-4222-abd1-974c48aa4ae4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:26:59.909218 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6273482d-fabb-4f1c-9fce-4767f4e7b44b req-9175890a-c628-4222-abd1-974c48aa4ae4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.1258080
May 20 16:26:59.944362 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f88f9712-cc45-493c-a79b-f319859656bd None None] New status for floating IP 0c7ce331-86f1-4fc2-8c6b-06391e928dca: DOWN {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:26:59.949671 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'name': 'network-vif-deleted', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:26:59.978928 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6273482d-fabb-4f1c-9fce-4767f4e7b44b req-e22a23d8-03a8-4822-835c-0bb6181e20cd tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0616558
May 20 16:27:00.064586 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd419699d-6355-4177-82f9-39936e18d34c', 'name': 'network-vif-deleted', 'tag': 'c643d109-2850-418c-806a-4eefcbdcc081', 'status': 'completed', 'code': 200}
May 20 16:27:00.176720 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38294) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:00.246138 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5acce283-5d96-49bd-b64b-4ecaf2879b38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:00.284384 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5acce283-5d96-49bd-b64b-4ecaf2879b38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:00.442932 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5acce283-5d96-49bd-b64b-4ecaf2879b38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:00.447105 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-84090926-7988-4271-825d-f6fd9954acf5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:00.462726 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5acce283-5d96-49bd-b64b-4ecaf2879b38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=139f796a-28b7-43ee-8acc-f0f1e38ad622,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:00.465455 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5acce283-5d96-49bd-b64b-4ecaf2879b38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:00.551085 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5acce283-5d96-49bd-b64b-4ecaf2879b38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:00.552249 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5acce283-5d96-49bd-b64b-4ecaf2879b38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "DELETE /v2.0/security-groups/139f796a-28b7-43ee-8acc-f0f1e38ad622 HTTP/1.1" status: 204  len: 168 time: 0.3745797
May 20 16:27:00.561357 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38298) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:00.578969 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.api.v2.resource [None req-31d83c1d-6c77-42da-bf95-faf185de875e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] show failed (client error): The resource could not be found.
May 20 16:27:00.582818 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-31d83c1d-6c77-42da-bf95-faf185de875e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups/139f796a-28b7-43ee-8acc-f0f1e38ad622 HTTP/1.1" status: 404  len: 347 time: 0.0177033
May 20 16:27:00.583104 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38302) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:00.805923 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Deleting port 9a300ad5-f9a2-4002-801e-7e50b95ed4fe {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:00.806270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:00.927587 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:00.927908 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:01.048780 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Calling delete_port for 9a300ad5-f9a2-4002-801e-7e50b95ed4fe owned by network:floatingip {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:01.223491 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a04617-2622-4f19-ad19-4d1ad9edec17 req-eaeb4e7f-f2e6-42ab-aee3-e894dc6ee48a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:01.224974 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a04617-2622-4f19-ad19-4d1ad9edec17 req-eaeb4e7f-f2e6-42ab-aee3-e894dc6ee48a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.1169925
May 20 16:27:01.225200 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:01.230399 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-61ce24ef-1fc9-40a3-a372-88fac5b20f98 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:01.283842 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76a04617-2622-4f19-ad19-4d1ad9edec17 req-c6c8dd57-bf4b-4876-9040-09b8ec34011f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0524824
May 20 16:27:01.289307 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event deleted for resources: {'Port': ['ID=9a300ad5-f9a2-4002-801e-7e50b95ed4fe,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:01.292410 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:01.383688 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:01.454761 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:01.455947 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "DELETE /v2.0/floatingips/0c7ce331-86f1-4fc2-8c6b-06391e928dca HTTP/1.1" status: 204  len: 168 time: 0.8718359
May 20 16:27:02.324086 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38316) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:02.330726 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2095226985', 'description': 'tempest-description--1035846724'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:02.341916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:02.349176 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:02.355923 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:02.369896 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:02.526915 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32bc829c-1d5d-4e1f-9dd8-e998abd9f826 req-013e4111-ca57-486f-96f0-43c23dbbf680 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:02.547372 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-32bc829c-1d5d-4e1f-9dd8-e998abd9f826 req-013e4111-ca57-486f-96f0-43c23dbbf680 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.1013629
May 20 16:27:02.611391 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-ae5fa1cc-d7cd-4509-9716-173dfa8a9826 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2251632
May 20 16:27:02.616603 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-32bc829c-1d5d-4e1f-9dd8-e998abd9f826 req-a2c7c0f0-24f1-47d0-a486-e9e59bdb1c2f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0676732
May 20 16:27:02.677163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:02.698430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:02.702885 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group_rule and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:02.705902 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:02.716037 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:02.802005 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:02.888468 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:02.893626 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9e29b15a-31a6-4c3a-bb42-5748c40883be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:02.939277 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8a807f28-b3c1-420c-9abe-bf45e2445898,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:02.942713 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:03.048554 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.049830 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.7247217
May 20 16:27:03.052743 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38322) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:03.057669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'security_group_rule': {'security_group_id': '8a807f28-b3c1-420c-9abe-bf45e2445898', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:03.064089 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:03.067944 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group_rule and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:03.074196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:03.081514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:03.186049 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.253375 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.316935 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.318984 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1845d0fa-a886-4766-bb1a-c67168087595 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:03.336728 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=802bb2f1-154f-47a3-a3aa-4a3fa553e760,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:03.343146 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:03.425849 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.428222 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3745475
May 20 16:27:03.430807 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38328) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:03.440595 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'security_group_rule': {'security_group_id': '8a807f28-b3c1-420c-9abe-bf45e2445898', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:03.447250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:03.451535 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:security_group_rule and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:03.454456 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:03.460327 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:03.565656 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.632869 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.756909 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913513'] for security_group_rule, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:03.766265 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ef4ba9be-95b7-49bc-9a96-63350640a5c1 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:03.799213 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f9d7629-b5f3-4bcf-bf4d-f3d940553cec,revision_number=0']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:03.812298 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:03.826693 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d1e599-79e0-4720-be18-a7942234f3ad req-9f880041-c2e6-4f77-b701-ab842fa03f86 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:03.828302 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b1d1e599-79e0-4720-be18-a7942234f3ad req-9f880041-c2e6-4f77-b701-ab842fa03f86 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0956933
May 20 16:27:03.881403 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b1d1e599-79e0-4720-be18-a7942234f3ad req-f2672bd8-67d3-479f-a1d7-445249a4c20b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0470331
May 20 16:27:04.258530 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:04.259656 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-20715550-0d13-4971-abde-299281322692 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.8267376
May 20 16:27:04.262552 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38334) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:04.268412 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:04.274722 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:04.278655 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:floatingip and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:04.281630 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:04.287637 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:04.380374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:04.529606 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:04.681709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Allocated IP 172.27.0.40 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/426d2c23-d7d6-45cb-a847-37b910ca79a5) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:27:04.837215 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:04.853601 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38340) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:04.951985 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:04.959088 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1ddee97c-2502-42e5-bf6d-b11ec903751b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:05.034323 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:27:05.035446 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:27:05.038207 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:27:05.082868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'Port': ['ID=426d2c23-d7d6-45cb-a847-37b910ca79a5,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:05.085910 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:05.144610 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.218019 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d16749-8b52-4d4f-88c4-c9e4fc240d27 req-6eb8cfcf-a8fc-4a3c-8c8a-112c6e39a4b3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:05.219531 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19d16749-8b52-4d4f-88c4-c9e4fc240d27 req-6eb8cfcf-a8fc-4a3c-8c8a-112c6e39a4b3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.1805091
May 20 16:27:05.275041 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Deleting port c5aab4f2-c066-45cd-b561-0df23db333c9 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:05.275467 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.287949 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.316669 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19d16749-8b52-4d4f-88c4-c9e4fc240d27 req-38bbb5e4-a587-4dca-8814-786ffcc5f4a7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0893970
May 20 16:27:05.428554 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.428900 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.505772 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.560046 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Calling delete_port for c5aab4f2-c066-45cd-b561-0df23db333c9 owned by network:floatingip {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:05.597473 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.601882 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5ee026f9-9e55-4eeb-af9a-5e48f48d9ee6 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:05.739026 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:05.768301 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'Port': ['ID=426d2c23-d7d6-45cb-a847-37b910ca79a5,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:05.772446 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:06.174564 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:06.179788 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-956b5ada-5bb6-41ac-9d9f-51d3f8910d4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:06.196864 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:06.198475 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-a5c2a839-b426-4f1f-aa72-8ddc1a872211 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.9348872
May 20 16:27:06.341019 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event deleted for resources: {'Port': ['ID=c5aab4f2-c066-45cd-b561-0df23db333c9,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:06.376308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:06.518374 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-87a15277-87e0-4993-a77c-6f610cb625ac tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-securitygroup--2095226985&fields=id&tenant_id=d01080acc33f4e539e888ae8b7bf7710 HTTP/1.1" status: 200  len: 267 time: 0.1432343
May 20 16:27:06.583975 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for floatingip, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:06.588262 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Floating IP f52a7162-c47a-4649-a5da-517923e725fb disassociated (deleted). External IP: 172.27.0.191, port: df15e363-aade-4bfb-9359-102c4aa7cae5.
May 20 16:27:06.751343 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936487d5-59c7-4915-87bc-34edff88b747 req-33c6e231-5791-4b9b-b6b1-07c2fec50de7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:06.752835 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-936487d5-59c7-4915-87bc-34edff88b747 req-33c6e231-5791-4b9b-b6b1-07c2fec50de7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.3046260
May 20 16:27:06.873184 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-aa717596-0b76-4ebc-b0e7-258e193ea642 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:06.875223 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-aa717596-0b76-4ebc-b0e7-258e193ea642 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 811 time: 0.3466649
May 20 16:27:06.908631 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-b7ec4d18-d32c-49bf-a802-002b99ba1b47 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/quotas/d01080acc33f4e539e888ae8b7bf7710 HTTP/1.1" status: 200  len: 375 time: 0.0240755
May 20 16:27:06.915045 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-936487d5-59c7-4915-87bc-34edff88b747 req-b3baf59c-186f-45f1-85ca-ed32a66d459b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1048484
May 20 16:27:07.155626 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-84c2e639-1aa1-4bb0-bfdf-e828a8e2015a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1885910
May 20 16:27:07.161747 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Router b2d11483-140f-49b3-9fa7-56159859e29c has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:07.252827 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-20a8a841-f850-4cf6-a2d6-55757c34dfe9 service neutron] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:27:07.254348 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-20a8a841-f850-4cf6-a2d6-55757c34dfe9 service neutron] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0841851
May 20 16:27:07.457093 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:07.467613 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] Sync routers for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:07.481341 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:07.481958 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711ef9e20>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:26:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:07.485220 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-00b9f4dd-f908-4b1a-8900-f85fb7d95891 service neutron] 10.222.0.64 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2177732
May 20 16:27:07.488725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:07.628376 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "DELETE /v2.0/floatingips/f52a7162-c47a-4649-a5da-517923e725fb HTTP/1.1" status: 204  len: 168 time: 2.7734799
May 20 16:27:07.631169 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:07.680282 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-eeb6e3f0-cdc3-4046-ba96-0d172e8e1e4e service neutron] 10.222.0.64 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1682358
May 20 16:27:07.787401 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:08.116231 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'status': 'completed', 'code': 200}
May 20 16:27:08.155111 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711ef9e20>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 5, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:08.160235 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] Checking router: b2d11483-140f-49b3-9fa7-56159859e29c for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:08.169252 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:08.169973 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711ef9e20>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:26:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:08.379214 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:08.427517 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fca44297-6311-4167-bb2e-fc7a04adecd9 req-4b162594-d638-4441-a42e-efdafeeff8d2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.2308476
May 20 16:27:08.492089 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b539014-4a0a-4708-aa2e-41578a0057a1 req-db9c63f6-d02d-4218-83ce-19afd3969e31 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:08.493571 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3b539014-4a0a-4708-aa2e-41578a0057a1 req-db9c63f6-d02d-4218-83ce-19afd3969e31 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.2469876
May 20 16:27:08.555609 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3b539014-4a0a-4708-aa2e-41578a0057a1 req-5d56c5b6-8eb7-4ee4-8d75-f3a569ae3865 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0558712
May 20 16:27:08.784923 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9ef74e-7845-4405-be17-8b0684345116 req-496b0f9b-b8fc-45e8-bd88-0f6238c6dc90 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:08.785638 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ca9ef74e-7845-4405-be17-8b0684345116 req-496b0f9b-b8fc-45e8-bd88-0f6238c6dc90 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Synchronizing usage tracker for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:27:08.798347 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711ef9e20>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 5, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:08.803461 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-193babf6-8ee1-4c66-b16f-74be48c030f7 None None] The sync data for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi is: [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:20:12Z', 'revision_number': 4, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '127ab9e0-c76f-4414-a97d-c9566d01d190', 'name': '', 'network_id': '39834042-f759-400b-9bc0-eb7c7abdd5c0', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'mac_address': 'fa:16:3e:87:47:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:11Z', 'updated_at': '2021-05-20T16:20:19Z', 'revision_number': 5, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'subnets': [{'id': 'b5688f1d-b45f-4391-b845-213d900ae645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:08.894562 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-ca9ef74e-7845-4405-be17-8b0684345116 req-496b0f9b-b8fc-45e8-bd88-0f6238c6dc90 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Unset dirty status for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:27:08.895907 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ca9ef74e-7845-4405-be17-8b0684345116 req-496b0f9b-b8fc-45e8-bd88-0f6238c6dc90 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.2195115
May 20 16:27:08.947948 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ca9ef74e-7845-4405-be17-8b0684345116 req-81b41540-3c9a-435d-afa9-10c8c97d6f4c tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0462091
May 20 16:27:09.069991 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41d7170a-919a-456e-b4c1-a0e3b14f9f59 None None] New status for floating IP f52a7162-c47a-4649-a5da-517923e725fb: DOWN {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:27:09.598315 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4b609457-bc81-4af3-b60c-a0408965053f req-d4b3c0cc-c37d-4619-9641-082cf8e6fc67 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.0426064
May 20 16:27:09.767624 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e593ebac-1451-413e-b8dc-089f8a9f2be3 req-73a30ac9-6fdd-4daa-9208-bde203002a51 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:09.769011 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e593ebac-1451-413e-b8dc-089f8a9f2be3 req-73a30ac9-6fdd-4daa-9208-bde203002a51 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0872195
May 20 16:27:09.814914 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e593ebac-1451-413e-b8dc-089f8a9f2be3 req-90fa0fa1-ba14-4bb4-bc75-5881a23b24a4 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385351
May 20 16:27:10.162156 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88298e59-1922-498a-8dc9-38fa6ccc6394 req-105735d6-d624-4f4f-9cda-4ff1313d75b2 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:10.163655 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-88298e59-1922-498a-8dc9-38fa6ccc6394 req-105735d6-d624-4f4f-9cda-4ff1313d75b2 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0984902
May 20 16:27:10.221015 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-88298e59-1922-498a-8dc9-38fa6ccc6394 req-45b09c98-cdfc-4360-895c-5100b23c55ba tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0511768
May 20 16:27:10.762570 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-30c14fa3-4363-4126-9698-f727eb8e5cd6 req-38a087da-173f-4e9c-9d8f-68551f2a5a22 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.0498595
May 20 16:27:11.030774 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140253d0-7d12-4237-9849-19b856ac1f88 req-31c269f7-5ccb-4737-8ac7-f0c324357fba tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:11.032402 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-140253d0-7d12-4237-9849-19b856ac1f88 req-31c269f7-5ccb-4737-8ac7-f0c324357fba tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0910423
May 20 16:27:11.081043 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-140253d0-7d12-4237-9849-19b856ac1f88 req-01fd8d9d-4bc0-479b-8e60-0084c6e19cbc tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418706
May 20 16:27:11.413543 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f4e387-e02c-4b3f-b157-53b661235111 req-359ee79a-9b5c-4688-b812-0b1ed12a82ea tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:11.414986 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-63f4e387-e02c-4b3f-b157-53b661235111 req-359ee79a-9b5c-4688-b812-0b1ed12a82ea tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0821946
May 20 16:27:11.458755 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-63f4e387-e02c-4b3f-b157-53b661235111 req-d3efd828-9f70-44ce-97ed-472de5767317 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380003
May 20 16:27:11.910824 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-25a0f1aa-a677-478c-a0e3-17812e462eea req-34af943d-3345-4ae3-a152-d1be3d1a7b64 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.0421131
May 20 16:27:12.273924 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e761324a-c753-4649-8f3e-ef9f134b2443 req-5f55dbb9-8abc-4e4a-bfa6-c3f1f9690d23 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:12.275400 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e761324a-c753-4649-8f3e-ef9f134b2443 req-5f55dbb9-8abc-4e4a-bfa6-c3f1f9690d23 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0864582
May 20 16:27:12.319696 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-e761324a-c753-4649-8f3e-ef9f134b2443 req-a0f69914-814a-4eeb-923c-608f1e4db320 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383880
May 20 16:27:12.650280 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a60f4fb-4c28-4cee-ba82-68fd55968736 req-1fb5c3b6-04da-402f-a919-dc2def9a4919 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:12.651830 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3a60f4fb-4c28-4cee-ba82-68fd55968736 req-1fb5c3b6-04da-402f-a919-dc2def9a4919 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.0889893
May 20 16:27:12.697721 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3a60f4fb-4c28-4cee-ba82-68fd55968736 req-eba6367f-1df8-4781-a4b6-499fb9486848 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397899
May 20 16:27:13.060731 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f62fdbf0-0003-4559-9867-020f433b8371 req-9562ee53-1ebf-4f3e-a94c-fd94c4c2ea38 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.0414765
May 20 16:27:13.551638 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-d33df6f3-4500-40ba-b23b-05fb73406a66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.553175 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-d33df6f3-4500-40ba-b23b-05fb73406a66 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8614158322ae423bb16b1c0645c66cf9&device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 1099 time: 0.0777309
May 20 16:27:13.564509 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5c0df8-6612-4e63-9ea1-8ec8396688aa req-ccf3eb2a-c47f-4874-89a9-1442b98e92c0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.565998 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2e5c0df8-6612-4e63-9ea1-8ec8396688aa req-ccf3eb2a-c47f-4874-89a9-1442b98e92c0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.1393213
May 20 16:27:13.599038 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb72effa-897a-4b00-af39-9538ef6808dd req-3e615ecd-fed8-4c8c-b7b8-e1a22c1b7ba1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.600599 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb72effa-897a-4b00-af39-9538ef6808dd req-3e615ecd-fed8-4c8c-b7b8-e1a22c1b7ba1 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 1098 time: 0.1177497
May 20 16:27:13.654284 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2e5c0df8-6612-4e63-9ea1-8ec8396688aa req-50bbf0e3-913b-4a9a-a5e3-16a260058f1f tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0816984
May 20 16:27:13.731139 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-2ebfe9e1-af63-43fb-b550-c5d717ccd8de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.736595 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-2ebfe9e1-af63-43fb-b550-c5d717ccd8de service neutron] 10.222.0.16 "GET /v2.0/networks?id=1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 200  len: 916 time: 0.1498766
May 20 16:27:13.755432 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb72effa-897a-4b00-af39-9538ef6808dd req-8c05bd0a-7136-472d-a90c-72ad408f1f90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.757055 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb72effa-897a-4b00-af39-9538ef6808dd req-8c05bd0a-7136-472d-a90c-72ad408f1f90 service neutron] 10.222.0.16 "GET /v2.0/networks?id=39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 200  len: 910 time: 0.1469378
May 20 16:27:13.814812 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-40f25c95-0d28-447e-9e55-784848df929a service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 200  len: 217 time: 0.0729630
May 20 16:27:13.873193 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb72effa-897a-4b00-af39-9538ef6808dd req-92eb31a9-f18e-4f94-814b-13da3549ded2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 200  len: 217 time: 0.1097052
May 20 16:27:13.882075 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-2a235003-1e6a-435f-9bbf-9a736ce27e49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.883132 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-2a235003-1e6a-435f-9bbf-9a736ce27e49 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 200  len: 854 time: 0.0621254
May 20 16:27:13.961867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb72effa-897a-4b00-af39-9538ef6808dd req-aef036d9-9bf5-4f2a-a00f-b489e656f22c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.963354 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb72effa-897a-4b00-af39-9538ef6808dd req-aef036d9-9bf5-4f2a-a00f-b489e656f22c service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 200  len: 848 time: 0.0795920
May 20 16:27:13.971108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5acd36b7-4a5c-48c8-813a-c181cdef307f req-23ebc829-65f6-4491-8671-1c72b63813cb tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:13.972631 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5acd36b7-4a5c-48c8-813a-c181cdef307f req-23ebc829-65f6-4491-8671-1c72b63813cb tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1531830
May 20 16:27:14.072173 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5acd36b7-4a5c-48c8-813a-c181cdef307f req-217a2da1-3ce7-4ba3-b3cb-606e1421028d tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0671310
May 20 16:27:14.073797 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-7a50aff9-fbb2-4664-b42d-a1b319a922a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:14.075791 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-7a50aff9-fbb2-4664-b42d-a1b319a922a7 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1c714e06-ccca-4a05-8bd6-477318017820&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1863608
May 20 16:27:14.090514 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb72effa-897a-4b00-af39-9538ef6808dd req-fb62426c-f3b1-41b1-ad79-b08b68b9f25b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:14.093280 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb72effa-897a-4b00-af39-9538ef6808dd req-fb62426c-f3b1-41b1-ad79-b08b68b9f25b service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=39834042-f759-400b-9bc0-eb7c7abdd5c0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1185532
May 20 16:27:14.277718 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-ac7259b5-05a7-42a2-882c-2ff52b6518c9 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1936917
May 20 16:27:14.347961 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-936596c0-fb17-4614-9c5c-e572ac3970ef req-9e99b633-41f6-418c-928b-e970bea41b70 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.0938177
May 20 16:27:14.409040 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb72effa-897a-4b00-af39-9538ef6808dd req-e77f57ec-3e74-4c7d-bc9b-4d900293ec86 service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3049464
May 20 16:27:14.424082 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-8a311f38-8b9f-4a80-a0ed-00056ef54e06 req-2ef13872-7a3d-4048-afd9-5bb9a3faff62 service neutron] 10.222.0.16 "GET /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1367066
May 20 16:27:14.602521 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71345e48-867c-4000-90c1-8d985c61479e req-a9c3ac30-76ec-47f6-9d26-93cfe25e21d7 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:14.603900 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-71345e48-867c-4000-90c1-8d985c61479e req-a9c3ac30-76ec-47f6-9d26-93cfe25e21d7 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 946 time: 0.1939714
May 20 16:27:14.607434 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-fb72effa-897a-4b00-af39-9538ef6808dd req-ab81efdc-71d8-47cb-81ea-41691783835d service neutron] 10.222.0.16 "GET /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1615863
May 20 16:27:14.649733 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-71345e48-867c-4000-90c1-8d985c61479e req-35fcda56-a747-4ec7-9386-a6eee3c6745a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398822
May 20 16:27:14.852397 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c6d40d5-0343-4993-a09e-b8c8a3ddaec3 req-cd394d8a-afc9-4bca-8c8f-ba7c4e3a520e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:14.853935 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5c6d40d5-0343-4993-a09e-b8c8a3ddaec3 req-cd394d8a-afc9-4bca-8c8f-ba7c4e3a520e tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.0820384
May 20 16:27:14.989223 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5c6d40d5-0343-4993-a09e-b8c8a3ddaec3 req-10313706-b897-47d3-9eda-29b5910fcafa tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1278389
May 20 16:27:15.045757 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-71bd92e0-13c1-40bd-ba8d-d1cddebba2f7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:15.047332 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-71bd92e0-13c1-40bd-ba8d-d1cddebba2f7 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 811 time: 0.1669636
May 20 16:27:15.105385 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-e3fa75ff-bc86-4e9b-a6c2-3b4323a3ed85 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d01080acc33f4e539e888ae8b7bf7710 HTTP/1.1" status: 200  len: 380 time: 0.0470846
May 20 16:27:15.120402 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'port': {'device_id': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'admin_state_up': True, 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'security_groups': ['8a807f28-b3c1-420c-9abe-bf45e2445898']}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:15.313110 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:15.319001 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Usage tracker for resource:port and tenant:d01080acc33f4e539e888ae8b7bf7710 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:15.322391 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:15.330843 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:15.339547 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82cc5c1b-ad0b-4037-85b6-dee1940b13a2 req-03a04965-212a-49b6-b589-6106e4a97aa5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:15.340999 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-82cc5c1b-ad0b-4037-85b6-dee1940b13a2 req-03a04965-212a-49b6-b589-6106e4a97aa5 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1386971
May 20 16:27:15.389070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-82cc5c1b-ad0b-4037-85b6-dee1940b13a2 req-f830c772-7cd9-45b2-bb8d-b2689b6cf1b6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418658
May 20 16:27:15.419656 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Made reservation on behalf of d01080acc33f4e539e888ae8b7bf7710 for: {'port': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:27:15.427566 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:15.534315 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-892265ec-a8be-4c35-ad47-518973804906 req-857479b3-9b04-41fa-a2ed-c210686027fb tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.0512931
May 20 16:27:15.628402 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Allocated IP 172.20.0.7 (27fc1d30-3be1-47fb-bb79-13211cc6a4bc/0920934c-dffc-4a63-a7b4-a241d1aa9eb3/d8d87b5c-b974-45eb-ae3b-f65255d49ca8) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:27:15.873684 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:15.896435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Transition to ACTIVE for port object d8d87b5c-b974-45eb-ae3b-f65255d49ca8 will not be triggered until provisioned by entity DHCP. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:27:15.900927 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-670e9c1f-5a44-4006-abd2-e75fc1f56a3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:15.905553 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5164de05-b965-4849-b9c5-89df9c566d72 req-7b0af73d-d6f8-492e-9509-749fd87439e4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:15.907091 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5164de05-b965-4849-b9c5-89df9c566d72 req-7b0af73d-d6f8-492e-9509-749fd87439e4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 946 time: 0.1489048
May 20 16:27:15.913877 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-68fdec87-56a9-411d-a57d-40cf596bca42 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:15.920139 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-68fdec87-56a9-411d-a57d-40cf596bca42 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Synchronizing usage tracker for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:27:15.928291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-68fdec87-56a9-411d-a57d-40cf596bca42 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Unset dirty status for tenant:b05498ab061b462e9f28e7d5e6bff55e on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:27:15.929951 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-68fdec87-56a9-411d-a57d-40cf596bca42 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.16 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 945 time: 0.1013873
May 20 16:27:15.962808 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5164de05-b965-4849-b9c5-89df9c566d72 req-78b13f34-0c01-48a6-bebe-4a6bcdf46e60 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0493970
May 20 16:27:16.074102 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Deleting port df15e363-aade-4bfb-9359-102c4aa7cae5 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:16.074594 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.088808 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.100692 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:16.195356 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:27:16.199960 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:27:16.206049 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:27:16.225346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] For port df15e363-aade-4bfb-9359-102c4aa7cae5, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=df15e363-aade-4bfb-9359-102c4aa7cae5,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:16.225744 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.282511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event updated for resources: {'Port': ['ID=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:16.358344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Calling delete_port for df15e363-aade-4bfb-9359-102c4aa7cae5 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:16.405058 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:16.430244 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:16.434390 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.462362 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6094776d-3c01-43c6-b19e-59f8f57e3133 req-e26611c7-2d12-4d89-92e9-af1f7efbf77d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:16.463854 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6094776d-3c01-43c6-b19e-59f8f57e3133 req-e26611c7-2d12-4d89-92e9-af1f7efbf77d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 943 time: 0.3310804
May 20 16:27:16.468825 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-98b85b01-547c-4fb8-8a82-99eae91c6a8d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:16.470065 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-98b85b01-547c-4fb8-8a82-99eae91c6a8d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:27:16.516512 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6094776d-3c01-43c6-b19e-59f8f57e3133 req-1b5036f2-b522-4b67-8b39-03baf42aa792 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453832
May 20 16:27:16.534199 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-fb4a8fbf-222f-4408-a6c5-236586a2287a None None] Provisioning for port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:27:16.540047 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-fb4a8fbf-222f-4408-a6c5-236586a2287a None None] Provisioning complete for port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:27:16.545113 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-fb4a8fbf-222f-4408-a6c5-236586a2287a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.564319 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4524145
May 20 16:27:16.579238 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Request body: {'port': {'device_id': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:16.583418 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-98b85b01-547c-4fb8-8a82-99eae91c6a8d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:27:16.586833 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-98b85b01-547c-4fb8-8a82-99eae91c6a8d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 946 time: 0.2222307
May 20 16:27:16.599342 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-fb4a8fbf-222f-4408-a6c5-236586a2287a None None] Port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:27:16.661323 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.697609 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-c3003608-857e-400d-b233-5d688cc8bc1f tempest-AttachVolumeNegativeTest-1777912835 tempest-AttachVolumeNegativeTest-1777912835-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:16.751957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event deleted for resources: {'Port': ['ID=df15e363-aade-4bfb-9359-102c4aa7cae5,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:16.755498 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:16.824663 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.834358 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] No DVR routers for this DVR port df15e363-aade-4bfb-9359-102c4aa7cae5 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:16.837560 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.841510 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-deleted', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:16.845968 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ba657a-f19b-40f3-9308-5af89b6d5464 req-496e512a-2604-49e2-830c-1899fb820aaa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:16.847435 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-80ba657a-f19b-40f3-9308-5af89b6d5464 req-496e512a-2604-49e2-830c-1899fb820aaa tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 867 time: 0.2335103
May 20 16:27:16.857766 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f982d00-6908-44a5-9e8d-bb3284cec902 req-b63565d8-43f3-498c-bef2-fbe2327d2605 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:16.859171 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6f982d00-6908-44a5-9e8d-bb3284cec902 req-b63565d8-43f3-498c-bef2-fbe2327d2605 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.2014840
May 20 16:27:16.865696 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Deleting port 6fcb7112-8b10-4db0-8244-62d90add9bad {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:16.866045 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:16.954670 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-9e1df482-ba2c-4e09-95c0-cebd78015df3 req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.16 "DELETE /v2.0/ports/df15e363-aade-4bfb-9359-102c4aa7cae5 HTTP/1.1" status: 204  len: 173 time: 1.0194638
May 20 16:27:16.983439 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-80ba657a-f19b-40f3-9308-5af89b6d5464 req-6dd92b93-0339-41e4-86f9-10bc20c58361 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/security-groups?id=af364d12-8f8f-41f5-b04f-0618bf1f0081&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1208265
May 20 16:27:17.001539 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] For port 6fcb7112-8b10-4db0-8244-62d90add9bad, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=6fcb7112-8b10-4db0-8244-62d90add9bad,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:17.002016 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.046441 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6f982d00-6908-44a5-9e8d-bb3284cec902 req-c4e6bf5c-6e7a-48fc-87b5-02fe149279e7 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1416535
May 20 16:27:17.118097 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:27:17.297480 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7bbe389f-e752-45c5-b9aa-4f1447a0925b', 'name': 'network-vif-deleted', 'tag': 'df15e363-aade-4bfb-9359-102c4aa7cae5', 'status': 'completed', 'code': 200}
May 20 16:27:17.331012 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:17.354936 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '224f3f0d-380f-45af-8889-4430982438fe', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'port_id': '224f3f0d-380f-45af-8889-4430982438fe', 'mac_address': 'fa:16:3e:5a:5b:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:27:17.418765 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.419081 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943400dd-ddb9-46a4-8883-bbe80d7c914a req-0f66ac66-b315-4925-8578-9100100085ec tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:17.419819 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-943400dd-ddb9-46a4-8883-bbe80d7c914a req-0f66ac66-b315-4925-8578-9100100085ec tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Synchronizing usage tracker for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:27:17.437133 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 224f3f0d-380f-45af-8889-4430982438fe {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:27:17.446817 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.447461 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.447889 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Floating IP 90d279ad-f91e-4479-bd2a-ff38cba18b35 disassociated. External IP: 172.27.0.58, port: 6fcb7112-8b10-4db0-8244-62d90add9bad.
May 20 16:27:17.448236 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Calling delete_port for 6fcb7112-8b10-4db0-8244-62d90add9bad owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:17.453304 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:17.502370 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19dcc0af-63df-4e95-ac1a-99f328a25f69 req-b592b431-dfdf-4a48-aa39-f2d69c1fdefd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:17.503914 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19dcc0af-63df-4e95-ac1a-99f328a25f69 req-b592b431-dfdf-4a48-aa39-f2d69c1fdefd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 946 time: 0.2400851
May 20 16:27:17.505530 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.507303 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-cec9aac3-b00e-41f8-8516-8393cc577357 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:17.512462 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d8d87b5c-b974-45eb-ae3b-f65255d49ca8 {{(pid=92421) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:27:17.542079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.575893 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-19dcc0af-63df-4e95-ac1a-99f328a25f69 req-8991b768-c70b-42cd-8765-7332dbfcebef tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0581048
May 20 16:27:17.585021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-943400dd-ddb9-46a4-8883-bbe80d7c914a req-0f66ac66-b315-4925-8578-9100100085ec tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Unset dirty status for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:27:17.586155 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943400dd-ddb9-46a4-8883-bbe80d7c914a req-0f66ac66-b315-4925-8578-9100100085ec tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 931 time: 0.4891398
May 20 16:27:17.592899 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=9']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:17.598500 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:17.643738 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943400dd-ddb9-46a4-8883-bbe80d7c914a req-c06bd2be-1e34-4100-af0f-3dc7330386bf tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420113
May 20 16:27:17.660114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.667139 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d60c1611-3f3d-4c21-ada7-0fd4c0df3cd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:17.667816 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Transition to ACTIVE for port object d8d87b5c-b974-45eb-ae3b-f65255d49ca8 will not be triggered until provisioned by entity L2. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:27:17.715313 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event deleted for resources: {'Port': ['ID=6fcb7112-8b10-4db0-8244-62d90add9bad,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:17.718263 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:17.760435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6085a2be-c78d-4f8c-9fe4-b14fa245c050 req-96b01db7-af87-45f0-a009-1e90dd42fcb5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:17.762212 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6085a2be-c78d-4f8c-9fe4-b14fa245c050 req-96b01db7-af87-45f0-a009-1e90dd42fcb5 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 944 time: 0.0848665
May 20 16:27:17.763643 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:17.769619 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f9a54fed-4042-4b39-9190-bab527a2bfa1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:17.917061 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:17.929535 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['224f3f0d-380f-45af-8889-4430982438fe'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:27:17.999844 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Pushing event updated for resources: {'Port': ['ID=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:18.003989 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:18.020953 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6085a2be-c78d-4f8c-9fe4-b14fa245c050 req-d506c260-14b7-4448-a9ed-113fb6dd0572 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2055819
May 20 16:27:18.113373 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Attempting to bind port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:27:18.113713 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Attempting to bind port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:27:18.114045 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Attempting to bind port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:27:18.120353 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:27:18.120686 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Attempting to bind port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 on network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:27:18.127305 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 26, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:27:18.127649 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Checking segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:27:18.128031 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Bound using segment: {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:27:18.128459 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Bound port: d8d87b5c-b974-45eb-ae3b-f65255d49ca8, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '785db113-1101-4c8c-b7d8-797ca01e729a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc'}}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:27:18.128806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:18.205950 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:18.227211 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:18.252431 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:18.253154 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7122d39a0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:26:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:18.334758 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] No DVR routers for this DVR port 6fcb7112-8b10-4db0-8244-62d90add9bad on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:18.344096 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:18.357620 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-157c927d-df7a-4ecf-9360-879efb68d45b req-2546dc6f-d78b-4d27-8acf-a1b6ba797203 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "GET /v2.0/ports?device_id=7bbe389f-e752-45c5-b9aa-4f1447a0925b HTTP/1.1" status: 200  len: 210 time: 0.1611447
May 20 16:27:18.414433 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] For port d8d87b5c-b974-45eb-ae3b-f65255d49ca8, host hv-cinder-68948, cleared binding levels {{(pid=92421) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:27:18.418200 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] For port d8d87b5c-b974-45eb-ae3b-f65255d49ca8, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92421) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:27:18.434144 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ca94665-5bcf-445f-a09d-da38cfcd963d req-1af8d8db-c9bb-4d0e-9f8b-f908661edbe5 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:18.435814 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ca94665-5bcf-445f-a09d-da38cfcd963d req-1af8d8db-c9bb-4d0e-9f8b-f908661edbe5 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.1813457
May 20 16:27:18.439962 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-54027d7f-e314-4bb0-896b-2e665c519a50 req-076a59da-5299-4c50-b8a4-e8a20987c972 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "DELETE /v2.0/ports/6fcb7112-8b10-4db0-8244-62d90add9bad HTTP/1.1" status: 204  len: 173 time: 1.8419755
May 20 16:27:18.486804 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5ca94665-5bcf-445f-a09d-da38cfcd963d req-b26367e4-8734-4b64-a63d-b36394392f58 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/security-groups?id=62841583-ef69-4bd6-9ba1-a6118731c4d9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438497
May 20 16:27:18.531492 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:18.536491 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:18.557782 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:18.564427 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5bfd2adc-c2c0-4115-84a9-680cb2fb83eb tempest-DeleteServersTestJSON-258476495 tempest-DeleteServersTestJSON-258476495-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:18.622061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:18.622899 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:18.624379 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] 10.222.0.16 "PUT /v2.0/ports/d8d87b5c-b974-45eb-ae3b-f65255d49ca8 HTTP/1.1" status: 200  len: 1093 time: 2.0517652
May 20 16:27:18.624890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:18.690146 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Pushing event updated for resources: {'Port': ['ID=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,revision_number=3']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:18.693577 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:18.707138 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ef31f93c-3737-49f1-be8a-64bbd8009759 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:18.720879 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'status': 'completed', 'code': 200}
May 20 16:27:18.888105 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89549686-1620-4fec-9295-2b027d94a2db req-a4fe20e9-9067-4e9c-a40b-1bdf8b8a24fa tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:18.888848 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-89549686-1620-4fec-9295-2b027d94a2db req-a4fe20e9-9067-4e9c-a40b-1bdf8b8a24fa tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Synchronizing usage tracker for tenant:8614158322ae423bb16b1c0645c66cf9 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:27:18.938321 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7122d39a0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:18.942291 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:18.950456 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:18.951163 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7122d39a0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:18.980031 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [req-89549686-1620-4fec-9295-2b027d94a2db req-a4fe20e9-9067-4e9c-a40b-1bdf8b8a24fa tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Unset dirty status for tenant:8614158322ae423bb16b1c0645c66cf9 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:27:18.981194 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-89549686-1620-4fec-9295-2b027d94a2db req-a4fe20e9-9067-4e9c-a40b-1bdf8b8a24fa tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.16 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 946 time: 0.2174921
May 20 16:27:18.986237 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2f808dca-5631-43a3-8e87-4a846fb48240 req-80bf1e10-d363-42fe-93c7-c2f1b4df2e8c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=ba416b1d-a014-4524-ad2d-929fdc116d84 HTTP/1.1" status: 200  len: 210 time: 0.2128880
May 20 16:27:19.063565 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12daabe3-feb0-452c-b14a-718e8a7bf383 req-e4e2be5e-c48c-42a6-a488-74b0870b5c58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:19.065432 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-12daabe3-feb0-452c-b14a-718e8a7bf383 req-e4e2be5e-c48c-42a6-a488-74b0870b5c58 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 1096 time: 0.3286412
May 20 16:27:19.099119 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37834bbb-de8f-4145-b011-4fb7c3a0250a req-8b1511ce-abe4-4056-8b30-03d3833bf1ae tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:19.100888 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-37834bbb-de8f-4145-b011-4fb7c3a0250a req-8b1511ce-abe4-4056-8b30-03d3833bf1ae tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 943 time: 0.1535394
May 20 16:27:19.134978 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6fcb7112-8b10-4db0-8244-62d90add9bad no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:19.154399 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Deleting port 16ee028f-977c-4c03-a101-a688c6953d30 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:19.154746 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:19.176425 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 6fcb7112-8b10-4db0-8244-62d90add9bad {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:19.176768 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 6fcb7112-8b10-4db0-8244-62d90add9bad not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:19.177186 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device df15e363-aade-4bfb-9359-102c4aa7cae5 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:19.221921 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: df15e363-aade-4bfb-9359-102c4aa7cae5 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:19.222298 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device df15e363-aade-4bfb-9359-102c4aa7cae5 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:19.227457 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:19.301887 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'name': 'network-vif-deleted', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:19.316268 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] For port 16ee028f-977c-4c03-a101-a688c6953d30, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=16ee028f-977c-4c03-a101-a688c6953d30,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:19.316794 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:19.349544 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-37834bbb-de8f-4145-b011-4fb7c3a0250a req-4ba597ad-54fa-4492-9c38-5159a09b810a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1902165
May 20 16:27:19.381312 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12daabe3-feb0-452c-b14a-718e8a7bf383 req-b5d897eb-0894-4eb4-807a-aa1693cb26d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:19.381312 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-12daabe3-feb0-452c-b14a-718e8a7bf383 req-b5d897eb-0894-4eb4-807a-aa1693cb26d8 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=d01080acc33f4e539e888ae8b7bf7710&shared=False HTTP/1.1" status: 200  len: 912 time: 0.2752180
May 20 16:27:19.449380 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c311934-2bef-4622-949f-8f6b7ccddb7e req-a659be09-eebd-41ee-b265-9a40f59a18d3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:19.457546 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4c311934-2bef-4622-949f-8f6b7ccddb7e req-a659be09-eebd-41ee-b265-9a40f59a18d3 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 944 time: 0.2930434
May 20 16:27:19.457727 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Calling delete_port for 16ee028f-977c-4c03-a101-a688c6953d30 owned by compute:nova {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:19.502607 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba416b1d-a014-4524-ad2d-929fdc116d84', 'name': 'network-vif-deleted', 'tag': '6fcb7112-8b10-4db0-8244-62d90add9bad', 'status': 'completed', 'code': 200}
May 20 16:27:19.563831 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4c311934-2bef-4622-949f-8f6b7ccddb7e req-cd8e5c4b-014b-47c1-b848-b77474f3d773 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1052868
May 20 16:27:19.603256 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7122d39a0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:19.608607 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-119305ee-8d5f-4ba6-8e2d-55f0912a254d None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:19.614788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38492) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:19.652959 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:19.654377 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12daabe3-feb0-452c-b14a-718e8a7bf383 req-a4fecc23-5db6-4b94-918a-e900b4e2f5ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:19.656005 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-12daabe3-feb0-452c-b14a-718e8a7bf383 req-a4fecc23-5db6-4b94-918a-e900b4e2f5ab service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2701221
May 20 16:27:19.696497 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:19.707391 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9f666c45-9f03-46af-b520-cfea10c8cea6 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:19.767237 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Pushing event deleted for resources: {'Port': ['ID=16ee028f-977c-4c03-a101-a688c6953d30,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:19.773409 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:19.775721 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:19.792060 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a81c54d1-a2cf-48a4-8ef7-2fd65d0da62d req-aafb5592-3800-43f3-87ac-212653c9e2f4 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.64 "GET /v2.0/ports?device_id=43a1b7df-becf-493f-a1eb-4b33536f33a4 HTTP/1.1" status: 200  len: 210 time: 0.0540779
May 20 16:27:19.845262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-9ffe064c-77dc-4972-b9cf-99448cc51781 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:19.847113 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-9ffe064c-77dc-4972-b9cf-99448cc51781 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 1096 time: 0.1421859
May 20 16:27:19.925546 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-e9766409-bdb8-4464-aaa9-367ec011bfe4 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8 HTTP/1.1" status: 200  len: 217 time: 0.0697553
May 20 16:27:19.939537 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e025711-662e-4f28-a7c2-7dfe7ef67785 None None] New status for floating IP 90d279ad-f91e-4479-bd2a-ff38cba18b35: DOWN {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:27:20.001201 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-0c51cc4b-51ec-40ca-bfe8-2cfdf6a42499 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:20.002771 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-0c51cc4b-51ec-40ca-bfe8-2cfdf6a42499 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.0713437
May 20 16:27:20.004450 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] No DVR routers for this DVR port 16ee028f-977c-4c03-a101-a688c6953d30 on host hv-cinder-68948 {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:20.010039 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:20.015430 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:20.117012 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-0ee979b8-c900-45f5-811e-aea958160b51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:20.117214 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-89549686-1620-4fec-9295-2b027d94a2db req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] 10.222.0.16 "DELETE /v2.0/ports/16ee028f-977c-4c03-a101-a688c6953d30 HTTP/1.1" status: 204  len: 173 time: 1.1297107
May 20 16:27:20.118860 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-0ee979b8-c900-45f5-811e-aea958160b51 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1089389
May 20 16:27:20.145373 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:20.149740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-da458372-5e46-482f-9cf8-235ef6270fe0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:20.172192 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=af364d12-8f8f-41f5-b04f-0618bf1f0081,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:20.176561 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:20.279984 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:20.299024 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] 10.222.0.64 "DELETE /v2.0/security-groups/af364d12-8f8f-41f5-b04f-0618bf1f0081 HTTP/1.1" status: 204  len: 168 time: 0.6814041
May 20 16:27:20.343358 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-38a7f653-2400-4fed-a1a3-e7796881fe4e service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2143402
May 20 16:27:20.404530 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-42dd06dd-b5a4-4e6b-a6fe-f68363fb4075 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-193855468&fields=id&tenant_id=a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 267 time: 0.0842259
May 20 16:27:20.424085 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38508) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:20.650164 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edc698b1-15dd-4f5e-a81f-ab95e2122aea req-f93fa07d-bb61-49b8-a810-08235328c666 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2989209
May 20 16:27:20.694124 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-13e73817-7ef3-47db-a36e-c6ba206ae41c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:20.695540 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-13e73817-7ef3-47db-a36e-c6ba206ae41c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 812 time: 0.2370706
May 20 16:27:20.707157 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719f0f8d-0bc5-4608-a90d-8d28f3c89fa0 req-e10281cf-c2d6-43f8-bc9b-19ede372ddb0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:20.708597 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-719f0f8d-0bc5-4608-a90d-8d28f3c89fa0 req-e10281cf-c2d6-43f8-bc9b-19ede372ddb0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 943 time: 0.2183819
May 20 16:27:20.732571 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-4ee33634-97c7-4ba7-9f2a-9b7c890e22d5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/quotas/a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 375 time: 0.0229535
May 20 16:27:20.792968 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-719f0f8d-0bc5-4608-a90d-8d28f3c89fa0 req-7825121f-2f32-499e-a705-d338b94bd110 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0757725
May 20 16:27:20.848887 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-d59ba321-6f6f-4fb4-8277-95b416b39c95 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1008265
May 20 16:27:20.865450 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bd075f21-bf63-498a-8080-222c8e159a9e service neutron] http://10.222.0.64:9696/v2.0/extensions returned with HTTP 200 {{(pid=92421) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 16:27:20.866488 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bd075f21-bf63-498a-8080-222c8e159a9e service neutron] 10.222.0.64 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0056539
May 20 16:27:21.102983 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:21.136230 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:27:21.175022 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-80edab29-ffa4-419b-879c-5e95be4b33cd service neutron] 10.222.0.64 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3021553
May 20 16:27:21.182898 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f4713f-e5c9-423f-8109-b3a162866367 req-a41e0abc-1154-49f4-a3f4-ae3d1b184ff0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:21.184483 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c5f4713f-e5c9-423f-8109-b3a162866367 req-a41e0abc-1154-49f4-a3f4-ae3d1b184ff0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 944 time: 0.2871261
May 20 16:27:21.226144 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 224f3f0d-380f-45af-8889-4430982438fe triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:27:21.226515 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:21.276484 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:21.329279 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c5f4713f-e5c9-423f-8109-b3a162866367 req-0d0cbd50-5c3d-4004-a7a4-0115c9bef5da tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1194165
May 20 16:27:21.359507 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:21.366080 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-35f5f4fa-d6ab-444f-a8f9-bf200b1284a8 service neutron] 10.222.0.64 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1804984
May 20 16:27:21.400790 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:21.401829 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:21.454083 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:21.455385 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 16ee028f-977c-4c03-a101-a688c6953d30 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:21.492143 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:21.504738 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'name': 'network-vif-deleted', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:21.548642 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '224f3f0d-380f-45af-8889-4430982438fe', 'code': 200}
May 20 16:27:21.554841 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 16ee028f-977c-4c03-a101-a688c6953d30 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:21.555272 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 16ee028f-977c-4c03-a101-a688c6953d30 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:21.585669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Deleting port 127ab9e0-c76f-4414-a97d-c9566d01d190 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:21.586018 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:21.593510 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=10']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:21.597324 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:21.670684 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43a1b7df-becf-493f-a1eb-4b33536f33a4', 'name': 'network-vif-deleted', 'tag': '16ee028f-977c-4c03-a101-a688c6953d30', 'status': 'completed', 'code': 200}
May 20 16:27:21.721558 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] For port 127ab9e0-c76f-4414-a97d-c9566d01d190, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=127ab9e0-c76f-4414-a97d-c9566d01d190,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:21.721968 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:21.843524 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Calling delete_port for 127ab9e0-c76f-4414-a97d-c9566d01d190 owned by network:router_interface {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:21.994601 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a0058f9-9141-4d21-844c-3ad14f2cd80a req-fc2ae24c-fbfd-4e4a-8019-d978c4702548 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:21.996117 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4a0058f9-9141-4d21-844c-3ad14f2cd80a req-fc2ae24c-fbfd-4e4a-8019-d978c4702548 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1099 time: 0.1335185
May 20 16:27:22.034597 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922a8c6b-2e6a-4b80-a442-2fecdc34b282 req-8dd8ab01-ce41-4e4f-a830-b319d2f5574d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:22.036244 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-922a8c6b-2e6a-4b80-a442-2fecdc34b282 req-8dd8ab01-ce41-4e4f-a830-b319d2f5574d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 943 time: 0.1203279
May 20 16:27:22.068923 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4a0058f9-9141-4d21-844c-3ad14f2cd80a req-5794ce43-6792-49ee-abac-9599f4c4aa30 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0644691
May 20 16:27:22.094136 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-922a8c6b-2e6a-4b80-a442-2fecdc34b282 req-be5d44ea-2398-4148-859a-0422e60599d4 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0485654
May 20 16:27:22.182187 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b672f59d-27f2-47d3-8cbf-4b00e2aa91c5 req-68e8a06d-660a-4b4a-9a76-b1ca39900810 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 210 time: 0.0432355
May 20 16:27:22.293639 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:22.298531 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7bd02143-8bbf-4cd1-af84-ad4bc473e29b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:22.346019 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Pushing event deleted for resources: {'Port': ['ID=127ab9e0-c76f-4414-a97d-c9566d01d190,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:22.373003 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:22.563744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf7dc70-c77a-459e-8c7d-fffe62c8cd18 req-e41bac52-a435-49d4-8fa6-bc2ef4eb530d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:22.565405 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf7dc70-c77a-459e-8c7d-fffe62c8cd18 req-e41bac52-a435-49d4-8fa6-bc2ef4eb530d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 946 time: 0.0887108
May 20 16:27:22.614635 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2bf7dc70-c77a-459e-8c7d-fffe62c8cd18 req-0e8dc93b-cb02-4525-9dd5-6566d6a54ec9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0428383
May 20 16:27:22.626927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:22.977741 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38580) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:22.978064 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Router b2d11483-140f-49b3-9fa7-56159859e29c has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:23.156236 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d8d87b5c-b974-45eb-ae3b-f65255d49ca8 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:27:23.165333 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:23.188489 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] Sync routers for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:23.193421 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] 10.222.0.64 "PUT /v2.0/routers/b2d11483-140f-49b3-9fa7-56159859e29c/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7636979
May 20 16:27:23.193635 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38586) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:23.393990 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:23.395651 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711d4f850>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:23.527489 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.db.resource_extend [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 20 16:27:23.572093 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7bccce60-dda7-4512-a083-cf22918fa4b2 req-cd2d552e-77c8-4424-9643-3a486a55af46 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 210 time: 0.0986276
May 20 16:27:23.729269 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593dfb27-795d-4807-b867-22145dab5696 req-460d8dbe-11df-436e-84c8-64de3493eaec tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:23.737999 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-593dfb27-795d-4807-b867-22145dab5696 req-460d8dbe-11df-436e-84c8-64de3493eaec tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 943 time: 0.3289082
May 20 16:27:23.864967 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port d8d87b5c-b974-45eb-ae3b-f65255d49ca8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:23.867991 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-593dfb27-795d-4807-b867-22145dab5696 req-35fef72e-c715-4b6a-b1c0-449cee9e0be9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1290295
May 20 16:27:23.887339 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'port_id': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'mac_address': 'fa:16:3e:87:58:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 645, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:27:23.905932 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks [] for router, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:23.915848 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:23.961235 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:27:24.097198 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.159983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.160552 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.192051 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d8d87b5c-b974-45eb-ae3b-f65255d49ca8 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:27:24.230634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Deleting port 7c049b55-c8f9-4a69-89fd-2154dc8abb00 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:24.231053 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.233339 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ff3b77-60e4-41c5-9139-8e772dea08a8 req-eadf1571-55e8-45ed-9bf8-0e4014ea2bd0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:24.235431 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2ff3b77-60e4-41c5-9139-8e772dea08a8 req-eadf1571-55e8-45ed-9bf8-0e4014ea2bd0 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 946 time: 0.3237746
May 20 16:27:24.248385 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port d8d87b5c-b974-45eb-ae3b-f65255d49ca8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:24.286502 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711d4f850>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60'}], 'enable_snat': True}, 'gw_port_id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:27:22Z', 'revision_number': 5, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port': {'id': '7c049b55-c8f9-4a69-89fd-2154dc8abb00', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:10:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:08Z', 'updated_at': '2021-05-20T16:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:24.290451 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] Checking router: b2d11483-140f-49b3-9fa7-56159859e29c for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:24.295656 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.298045 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:24.348999 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] Routers {'b2d11483-140f-49b3-9fa7-56159859e29c'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:24.349799 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711d4f850>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['b2d11483-140f-49b3-9fa7-56159859e29c'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:24.366159 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d2ff3b77-60e4-41c5-9139-8e772dea08a8 req-19f46f4c-91c5-4619-8a1b-746b2a678d54 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1176076
May 20 16:27:24.379514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] For port 7c049b55-c8f9-4a69-89fd-2154dc8abb00, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=7c049b55-c8f9-4a69-89fd-2154dc8abb00,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:24.380015 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.516023 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:24.527971 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:24.530766 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Calling delete_port for 7c049b55-c8f9-4a69-89fd-2154dc8abb00 owned by network:router_gateway {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:24.540279 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] Set router b2d11483-140f-49b3-9fa7-56159859e29c gateway port host: None {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:24.681216 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711d4f850>, [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:27:24Z', 'revision_number': 6, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port_host': None}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:24.689517 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa81d878-e8c8-4548-a61c-b86327b30e5d None None] The sync data for ids ['b2d11483-140f-49b3-9fa7-56159859e29c'] in dv-cinder-689486-13-iscsi is: [{'id': 'b2d11483-140f-49b3-9fa7-56159859e29c', 'name': 'tempest-TestShelveInstance-1006810869-router', 'tenant_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:07Z', 'updated_at': '2021-05-20T16:27:24Z', 'revision_number': 6, 'project_id': 'b05498ab061b462e9f28e7d5e6bff55e', 'gw_port_host': None}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:24.697788 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['d8d87b5c-b974-45eb-ae3b-f65255d49ca8'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:27:24.782843 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-b8ab5560-1a10-47e8-ae65-f97481e73972 req-976c791e-f928-4aa6-a0e4-0977225a6bdf tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 210 time: 0.0525255
May 20 16:27:24.811913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.816753 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-af86cfa8-a7c8-48d4-aa61-483ba9c6e745 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:24.866380 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Pushing event deleted for resources: {'Port': ['ID=7c049b55-c8f9-4a69-89fd-2154dc8abb00,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:24.869541 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9fd0e826-89a7-41e8-99e9-ea267ee8cbf9 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:24.870976 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9fd0e826-89a7-41e8-99e9-ea267ee8cbf9 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 812 time: 0.2530687
May 20 16:27:24.901265 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:24.904103 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Deleting port 5eb209a1-6f70-43b5-b05d-364af120a723 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:24.904444 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:24.955839 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-059415c7-50cf-4b83-b290-75b2d782d161 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 379 time: 0.0752509
May 20 16:27:24.973906 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.014051 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'port': {'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'admin_state_up': True, 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'security_groups': ['da77fa6e-aadb-4acb-8e30-527bbdccd591']}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:25.171425 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.174193 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.272817 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] For port 5eb209a1-6f70-43b5-b05d-364af120a723, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=5eb209a1-6f70-43b5-b05d-364af120a723,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:25.273174 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.339365 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.339994 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b2d11483-140f-49b3-9fa7-56159859e29c {{(pid=92422) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:27:25.355270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.356414 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] 10.222.0.64 "DELETE /v2.0/routers/b2d11483-140f-49b3-9fa7-56159859e29c HTTP/1.1" status: 204  len: 168 time: 2.1618831
May 20 16:27:25.358951 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38632) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:25.409465 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Calling delete_port for 5eb209a1-6f70-43b5-b05d-364af120a723 owned by network:router_interface {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:25.423176 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_v2 [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Deleting subnet b5688f1d-b45f-4391-b845-213d900ae645 {{(pid=92422) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:27:25.426250 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.441045 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc88871-8123-48a8-b8c7-e29a4a5227ad req-96bb6bbb-caaf-4eb9-a8ca-de53dfae5662 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:25.441045 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1cc88871-8123-48a8-b8c7-e29a4a5227ad req-96bb6bbb-caaf-4eb9-a8ca-de53dfae5662 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 944 time: 0.4047639
May 20 16:27:25.446883 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:25.454094 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:port and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:25.475240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:25.477533 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6219245'] for subnet, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.483989 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:25.548238 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1cc88871-8123-48a8-b8c7-e29a4a5227ad req-f2120980-e620-4ce3-be75-8e75910619b9 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0983889
May 20 16:27:25.602948 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:25.716021 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7c049b55-c8f9-4a69-89fd-2154dc8abb00 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:25.757015 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 7c049b55-c8f9-4a69-89fd-2154dc8abb00 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:25.757706 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7c049b55-c8f9-4a69-89fd-2154dc8abb00 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:25.758220 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 127ab9e0-c76f-4414-a97d-c9566d01d190 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:25.794678 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 127ab9e0-c76f-4414-a97d-c9566d01d190 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:25.795129 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 127ab9e0-c76f-4414-a97d-c9566d01d190 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:25.916155 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Made reservation on behalf of a6bd88ff65e9420a8ccb36968532c4f6 for: {'port': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:27:25.920279 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.047001 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d1166bf2-8efb-45cb-868d-0a78c67a7858 req-b4970074-27c8-4d12-a081-57bdb9a6c62e tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 210 time: 0.0939381
May 20 16:27:26.093916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6358801', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6223409'] for subnet, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.098048 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:26.132575 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b5688f1d-b45f-4391-b845-213d900ae645,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:26.135645 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:26.136634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.144364 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea66f695-8a31-429c-9926-e02faf664b75 req-2bcde77f-13b5-420e-b604-32a184bab369 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:26.144743 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dccd2438-a89c-489d-89a0-046cfd0ab43f None None] Network 39834042-f759-400b-9bc0-eb7c7abdd5c0 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:27:26.145497 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e6e59a38-29ea-462f-ba40-11a3da84c9da admin admin] 10.222.0.64 "DELETE /v2.0/subnets/b5688f1d-b45f-4391-b845-213d900ae645 HTTP/1.1" status: 204  len: 168 time: 0.7855377
May 20 16:27:26.145816 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ea66f695-8a31-429c-9926-e02faf664b75 req-2bcde77f-13b5-420e-b604-32a184bab369 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 946 time: 0.5943172
May 20 16:27:26.148047 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38640) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:26.265551 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ea66f695-8a31-429c-9926-e02faf664b75 req-61b5f95f-95fa-494b-bbdf-8fe3ef57b30b tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1070030
May 20 16:27:26.271495 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Allocated IP 172.20.0.4 (a02876f9-a796-4512-9044-eb08bb5d54c6/cb578eb9-d6e8-4e33-8d08-43894fe771d7/5ac737cf-18db-4859-93ae-3ce4c7a6e5c9) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:27:26.272180 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.311930 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.319747 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:26.351848 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Deleting port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:26.352301 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.373763 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Pushing event deleted for resources: {'Port': ['ID=5eb209a1-6f70-43b5-b05d-364af120a723,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:26.410589 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:26.493415 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] For port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:26.493815 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.522703 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] DHCP port deletion for 39834042-f759-400b-9bc0-eb7c7abdd5c0 request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:27:26.632002 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Calling delete_port for 9888eb71-0361-4b2a-9aef-ba7cfdec74ca owned by network:dhcp {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:26.643406 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] Deleting port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:26.644234 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.756511 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.756713 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] For port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,segment=NetworkSegment(855ceff0-a862-4f90-88cc-63bc7047c2ce),segment_id=855ceff0-a862-4f90-88cc-63bc7047c2ce)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:26.757149 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.762356 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d8eee638-1bc5-4bae-aae0-c117b217ee54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:26.806381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Pushing event deleted for resources: {'Port': ['ID=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:26.809335 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:26.810110 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] No DVR routers for this DVR port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca on host dv-cinder-689486-13-iscsi {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:26.886217 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] Calling delete_port for 9888eb71-0361-4b2a-9aef-ba7cfdec74ca owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:26.891683 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.915522 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.924658 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Transition to ACTIVE for port object 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 will not be triggered until provisioned by entity DHCP. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:27:26.939375 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.953024 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe71234ff70>,) {'filters': {'network_id': ['39834042-f759-400b-9bc0-eb7c7abdd5c0']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:26.965421 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71234ff70>, '855ceff0-a862-4f90-88cc-63bc7047c2ce') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:26.965801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe71234ff70>, '855ceff0-a862-4f90-88cc-63bc7047c2ce') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:26.977972 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:26.994764 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.001036 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Releasing vlan 629 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:27:27.001496 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:27:27.014902 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:27:27.017697 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9af45b19-3298-4cd2-8a84-bb7e07aa6538 req-04f80d3a-d328-4aff-b824-617168e9a7bd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:27.017697 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9af45b19-3298-4cd2-8a84-bb7e07aa6538 req-04f80d3a-d328-4aff-b824-617168e9a7bd tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 944 time: 0.3175666
May 20 16:27:27.024614 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.028594 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:27.075954 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] Pushing event deleted for resources: {'Port': ['ID=9888eb71-0361-4b2a-9aef-ba7cfdec74ca,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:27.078497 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:27.084079 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93d7d7d9-068d-445e-b3c1-903a9b949e0f None None] No DVR routers for this DVR port 9888eb71-0361-4b2a-9aef-ba7cfdec74ca on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:27.162473 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.163740 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9af45b19-3298-4cd2-8a84-bb7e07aa6538 req-a3f9b144-807d-46f9-b269-8687fe5cda27 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1324129
May 20 16:27:27.170574 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:27.173645 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d8d87b5c-b974-45eb-ae3b-f65255d49ca8 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:27:27.193598 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.199895 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Pushing event deleted for resources: {'Network': ['ID=39834042-f759-400b-9bc0-eb7c7abdd5c0,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:27.203229 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:27.236820 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.265559 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] 10.222.0.64 "DELETE /v2.0/networks/39834042-f759-400b-9bc0-eb7c7abdd5c0 HTTP/1.1" status: 204  len: 168 time: 1.1164033
May 20 16:27:27.268433 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38650) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:27.282627 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-24090a3c-434b-45e5-a12f-6885eb5e1fa0 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:27.310441 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:27:27.316084 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:27:27.316552 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.370514 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Network a02876f9-a796-4512-9044-eb08bb5d54c6 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:27:27.384087 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:27:27.445323 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.489095 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port d8d87b5c-b974-45eb-ae3b-f65255d49ca8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:27.490107 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:27.546945 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'code': 200}
May 20 16:27:27.556432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.561051 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:27.584663 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:27:27.645968 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:27.651672 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:27.655151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:27.663697 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.381s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:27.706583 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Router 611172fd-bcae-4d71-9f24-054476247eea has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:27.713097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:27.713728 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.726070 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a009106e-6fc7-4c97-ab81-36be69b4f5b9 req-35912f77-1497-4961-b218-dcb009853ce1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:27.727650 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a009106e-6fc7-4c97-ab81-36be69b4f5b9 req-35912f77-1497-4961-b218-dcb009853ce1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 931 time: 0.4987838
May 20 16:27:27.768276 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-ef121167-c712-496d-9a88-1a74e3a6e9c5 None None] Provisioning for port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:27:27.774574 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-ef121167-c712-496d-9a88-1a74e3a6e9c5 None None] Provisioning complete for port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:27:27.775940 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ef121167-c712-496d-9a88-1a74e3a6e9c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:27.841148 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-ef121167-c712-496d-9a88-1a74e3a6e9c5 None None] Port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:27:27.843042 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 9888eb71-0361-4b2a-9aef-ba7cfdec74ca no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:27.873229 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a009106e-6fc7-4c97-ab81-36be69b4f5b9 req-5a37c700-d04a-42ce-a18e-d000a06bd4fe tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0716398
May 20 16:27:27.880959 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 9888eb71-0361-4b2a-9aef-ba7cfdec74ca {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:27.881306 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 9888eb71-0361-4b2a-9aef-ba7cfdec74ca not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:27.927972 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-9f58a511-98ae-49e6-a12d-d0ee113cc6c5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.9176404
May 20 16:27:27.940090 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Request body: {'port': {'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:28.002561 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe39cc20-2e5d-43c9-b309-0e2afdfbbc7b req-120ca062-caa5-4c43-9cc4-11c0ba927593 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:28.004075 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fe39cc20-2e5d-43c9-b309-0e2afdfbbc7b req-120ca062-caa5-4c43-9cc4-11c0ba927593 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 1098 time: 0.1103840
May 20 16:27:28.018605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:28.027460 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] Sync routers for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:28.037712 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:28.039136 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712bf8a60>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:28.050641 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-2531211f-5abd-40c8-b4c6-134efe957825 admin admin] 10.222.0.64 "PUT /v2.0/routers/611172fd-bcae-4d71-9f24-054476247eea/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 5.0694120
May 20 16:27:28.054213 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38656) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:28.091980 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [req-fe39cc20-2e5d-43c9-b309-0e2afdfbbc7b req-216b9de0-28c0-4e5a-b9ae-ae6ea1b86b01 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0531733
May 20 16:27:28.106715 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:28.158706 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:28.222697 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:28.412996 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks [] for router, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:28.541990 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Deleting port 096042a0-8761-46e2-813e-5de741a4f5fa {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:28.542572 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:28.552813 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712bf8a60>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:27:26Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:28.556965 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] Checking router: 611172fd-bcae-4d71-9f24-054476247eea for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:28.565382 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] Routers {'611172fd-bcae-4d71-9f24-054476247eea'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:28.565980 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712bf8a60>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['611172fd-bcae-4d71-9f24-054476247eea'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:28.666243 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] For port 096042a0-8761-46e2-813e-5de741a4f5fa, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=096042a0-8761-46e2-813e-5de741a4f5fa,segment=NetworkSegment(5693de47-397e-4e5a-878b-f95a4a1ed194),segment_id=5693de47-397e-4e5a-878b-f95a4a1ed194)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:28.666798 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:28.698699 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb2eb7f-9ccd-4d85-9882-c819b83f29db req-41d4b93a-fb5a-4528-8217-4c7c2f114576 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:28.700224 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-afb2eb7f-9ccd-4d85-9882-c819b83f29db req-41d4b93a-fb5a-4528-8217-4c7c2f114576 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 945 time: 0.4034634
May 20 16:27:28.745759 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] Set router 611172fd-bcae-4d71-9f24-054476247eea gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:28.765900 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:28.795287 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Calling delete_port for 096042a0-8761-46e2-813e-5de741a4f5fa owned by network:router_interface {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:28.798219 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-afb2eb7f-9ccd-4d85-9882-c819b83f29db req-63ef19a3-453a-4ec8-9865-37efe6f86a4e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0849035
May 20 16:27:28.914138 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 {{(pid=92421) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:27:28.923529 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:28.974061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Deleting port 20adbbc8-301e-4055-8fdb-062dcd9e25f4 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:28.974778 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.024970 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.029072 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8e612ee0-995f-44e6-a539-701c063c96cb tempest-VolumesSnapshotTestJSON-902856305 tempest-VolumesSnapshotTestJSON-902856305-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:29.038241 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Transition to ACTIVE for port object 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 will not be triggered until provisioned by entity L2. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:27:29.063238 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712bf8a60>, [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:27:26Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:29.069749 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0723cdc0-c4b8-4066-9724-475212a1e4ff None None] The sync data for ids ['611172fd-bcae-4d71-9f24-054476247eea'] in dv-cinder-689486-13-iscsi is: [{'id': '611172fd-bcae-4d71-9f24-054476247eea', 'name': 'tempest-TestMinimumBasicScenario-2033331546-router', 'tenant_id': '8614158322ae423bb16b1c0645c66cf9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56'}], 'enable_snat': True}, 'gw_port_id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:27:26Z', 'revision_number': 5, 'project_id': '8614158322ae423bb16b1c0645c66cf9', 'gw_port': {'id': '20adbbc8-301e-4055-8fdb-062dcd9e25f4', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:5f:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '611172fd-bcae-4d71-9f24-054476247eea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:49Z', 'updated_at': '2021-05-20T16:22:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:29.079267 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Pushing event deleted for resources: {'Port': ['ID=096042a0-8761-46e2-813e-5de741a4f5fa,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:29.083396 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:29.253118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.266768 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:29.356851 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.412071 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.458385 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Pushing event updated for resources: {'Port': ['ID=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:29.462058 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:29.463870 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] For port 20adbbc8-301e-4055-8fdb-062dcd9e25f4, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=20adbbc8-301e-4055-8fdb-062dcd9e25f4,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:29.464228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.639374 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Calling delete_port for 20adbbc8-301e-4055-8fdb-062dcd9e25f4 owned by network:router_gateway {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:29.667622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a67add0-2bf3-480a-9c37-24335bd576c9 req-64281e5f-8e34-4732-92e4-301b481cdea9 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:29.670942 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-4a67add0-2bf3-480a-9c37-24335bd576c9 req-64281e5f-8e34-4732-92e4-301b481cdea9 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:27:29.715785 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Attempting to bind port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:27:29.716125 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Attempting to bind port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:27:29.716447 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Attempting to bind port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:27:29.730883 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 on network a02876f9-a796-4512-9044-eb08bb5d54c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:27:29.730883 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Attempting to bind port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:27:29.731089 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 5eb209a1-6f70-43b5-b05d-364af120a723 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:29.732634 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 27, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:27:29.732966 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Checking segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:27:29.733338 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Bound using segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:27:29.733759 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Bound port: 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:27:29.734100 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.765606 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 5eb209a1-6f70-43b5-b05d-364af120a723 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:29.775990 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 5eb209a1-6f70-43b5-b05d-364af120a723 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:29.804598 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-4a67add0-2bf3-480a-9c37-24335bd576c9 req-64281e5f-8e34-4732-92e4-301b481cdea9 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:27:29.805740 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4a67add0-2bf3-480a-9c37-24335bd576c9 req-64281e5f-8e34-4732-92e4-301b481cdea9 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 931 time: 0.8101091
May 20 16:27:29.890417 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4a67add0-2bf3-480a-9c37-24335bd576c9 req-1d898013-a60b-4503-912d-30b13cd0a215 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0755584
May 20 16:27:29.892088 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] For port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9, host hv-cinder-68948, cleared binding levels {{(pid=92421) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:27:29.895464 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] For port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92421) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:27:29.944161 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Router f9ebaaaf-9e9b-4128-9058-4315baa484e1 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:29.984766 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:29.997724 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:30.081200 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:30.081833 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:30.083220 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] 10.222.0.16 "PUT /v2.0/ports/5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 200  len: 1093 time: 2.1479442
May 20 16:27:30.085109 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:30.110269 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Pushing event updated for resources: {'Port': ['ID=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,revision_number=3']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:30.114739 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:30.124094 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:30.134531 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] Sync routers for ids ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:30.136180 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4b5e84-afe3-4400-9ca5-4ee9b825930a req-ac9c67dc-3846-4aab-b195-97df13b5e375 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:30.137855 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6c4b5e84-afe3-4400-9ca5-4ee9b825930a req-ac9c67dc-3846-4aab-b195-97df13b5e375 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 945 time: 0.1936681
May 20 16:27:30.142680 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] 10.222.0.64 "PUT /v2.0/routers/f9ebaaaf-9e9b-4128-9058-4315baa484e1/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8730416
May 20 16:27:30.146605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38668) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:30.147248 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] Routers {'f9ebaaaf-9e9b-4128-9058-4315baa484e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:30.147982 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712fa2490>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:30.219295 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'status': 'completed', 'code': 200}
May 20 16:27:30.228836 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:30.272843 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1447e0ac-9232-4e4f-947d-d6952208ec06 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:30.339618 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Pushing event deleted for resources: {'Port': ['ID=20adbbc8-301e-4055-8fdb-062dcd9e25f4,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:30.345119 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:30.347155 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] Set router f9ebaaaf-9e9b-4128-9058-4315baa484e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:30.432946 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6c4b5e84-afe3-4400-9ca5-4ee9b825930a req-e989c2a5-8e16-4bed-b8f5-46c3030a021c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2870860
May 20 16:27:30.551647 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:30.663274 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712fa2490>, [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:27:28Z', 'revision_number': 5, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:30.667307 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] Checking router: f9ebaaaf-9e9b-4128-9058-4315baa484e1 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:30.676727 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] Routers {'f9ebaaaf-9e9b-4128-9058-4315baa484e1'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:30.677344 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712fa2490>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:30.851080 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] Set router f9ebaaaf-9e9b-4128-9058-4315baa484e1 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:30.867205 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a07b03-aad9-4d47-92f0-ac3bde2aa56a req-5c70af58-da24-4967-94c8-c0b914c0dc95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:30.868710 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d0a07b03-aad9-4d47-92f0-ac3bde2aa56a req-5c70af58-da24-4967-94c8-c0b914c0dc95 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1096 time: 0.6409276
May 20 16:27:30.869853 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks [] for router, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:30.970976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:30.974292 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.134848 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712fa2490>, [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:27:28Z', 'revision_number': 5, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:31.138835 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f074630-24b4-49d2-a549-787cf9ffcce5 None None] The sync data for ids ['f9ebaaaf-9e9b-4128-9058-4315baa484e1'] in dv-cinder-689486-13-iscsi is: [{'id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'name': 'tempest-TestShelveInstance-2072420104-router', 'tenant_id': '33df6a8593d344c49044f79e9a65e01f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230'}], 'enable_snat': True}, 'gw_port_id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:20:17Z', 'updated_at': '2021-05-20T16:27:28Z', 'revision_number': 5, 'project_id': '33df6a8593d344c49044f79e9a65e01f', 'gw_port': {'id': '2d91e003-e7a9-4c22-9a99-1564da9f0717', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:42:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ebaaaf-9e9b-4128-9058-4315baa484e1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 408, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.230', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:20:18Z', 'updated_at': '2021-05-20T16:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:31.247796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e16fdf-af13-41fb-9fd0-f05966cd74c8 req-d0c181fa-8be2-451e-92df-de308489aa4a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:31.249195 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-35e16fdf-af13-41fb-9fd0-f05966cd74c8 req-d0c181fa-8be2-451e-92df-de308489aa4a tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 945 time: 0.7065322
May 20 16:27:31.260818 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38676) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:31.266282 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Request body: {'floatingip': {'port_id': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:31.267508 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.268000 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Fanout notify agent at l3_agent the message router_deleted on router 611172fd-bcae-4d71-9f24-054476247eea {{(pid=92421) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:27:31.283696 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a07b03-aad9-4d47-92f0-ac3bde2aa56a req-cd7bc3d0-5f26-45c2-bcc1-da9e438be5ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:31.285157 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d0a07b03-aad9-4d47-92f0-ac3bde2aa56a req-cd7bc3d0-5f26-45c2-bcc1-da9e438be5ea service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&shared=False HTTP/1.1" status: 200  len: 913 time: 0.3688169
May 20 16:27:31.316376 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.352905 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.357086 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.360811 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d9a3bedd-5229-4fbd-9b2e-36dfb6ef2ced admin admin] 10.222.0.64 "DELETE /v2.0/routers/611172fd-bcae-4d71-9f24-054476247eea HTTP/1.1" status: 204  len: 168 time: 3.3036070
May 20 16:27:31.368473 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a53c8a6-a7a8-4f92-a51a-2e08c20b8400 req-c814bb53-d8c3-467e-bc40-6fd22a36bcea tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:31.369995 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a53c8a6-a7a8-4f92-a51a-2e08c20b8400 req-c814bb53-d8c3-467e-bc40-6fd22a36bcea tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.3530357
May 20 16:27:31.402312 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38680) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:31.543734 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1a53c8a6-a7a8-4f92-a51a-2e08c20b8400 req-b2342c1a-24ce-43b1-a0ed-593cd4d383bc tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1236041
May 20 16:27:31.548984 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a07b03-aad9-4d47-92f0-ac3bde2aa56a req-746ebcec-cdd4-4284-9cdc-7dcdf48d17c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:31.550485 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d0a07b03-aad9-4d47-92f0-ac3bde2aa56a req-746ebcec-cdd4-4284-9cdc-7dcdf48d17c6 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2575190
May 20 16:27:31.563407 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Deleting port 2d91e003-e7a9-4c22-9a99-1564da9f0717 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:31.563748 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.570197 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_v2 [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Deleting subnet 227d5494-8b2f-4a70-9e77-58d4d0e45746 {{(pid=92422) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:27:31.573440 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.712948 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6219245'] for subnet, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.748266 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] For port 2d91e003-e7a9-4c22-9a99-1564da9f0717, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=2d91e003-e7a9-4c22-9a99-1564da9f0717,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:31.748576 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:31.765725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-e90dd56a-1a9a-4bcb-9474-53fe826b015d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:31.767265 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-e90dd56a-1a9a-4bcb-9474-53fe826b015d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1096 time: 0.1730416
May 20 16:27:31.883287 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Calling delete_port for 2d91e003-e7a9-4c22-9a99-1564da9f0717 owned by network:router_gateway {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:31.887985 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 096042a0-8761-46e2-813e-5de741a4f5fa no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:31.922691 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 096042a0-8761-46e2-813e-5de741a4f5fa {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:31.923039 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 096042a0-8761-46e2-813e-5de741a4f5fa not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:31.923536 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 20adbbc8-301e-4055-8fdb-062dcd9e25f4 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:31.949289 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bb471a3c-1568-45ef-bc72-5c385fe671b8 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 200  len: 217 time: 0.0730579
May 20 16:27:31.960157 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 20adbbc8-301e-4055-8fdb-062dcd9e25f4 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:31.960523 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 20adbbc8-301e-4055-8fdb-062dcd9e25f4 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:32.001729 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.028759 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bdaf1ef4-8059-4b2d-8404-43cf96d9db6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:32.030193 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-bdaf1ef4-8059-4b2d-8404-43cf96d9db6e service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0744739
May 20 16:27:32.133859 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-a4845f23-27ed-46fe-9790-b2cd8c82509d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:32.135326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-a4845f23-27ed-46fe-9790-b2cd8c82509d service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0971115
May 20 16:27:32.434914 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-afc9ad96-5646-4f9d-b477-9f3e4ab386db service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2931020
May 20 16:27:32.467928 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.475847 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.482488 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4ca-af98-4a6f-81f3-187097e5963f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:32.528099 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.575642 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Pushing event deleted for resources: {'Port': ['ID=2d91e003-e7a9-4c22-9a99-1564da9f0717,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:32.581432 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6358801', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6223409'] for subnet, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.594888 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:32.609124 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:32.641605 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Pushing event deleted for resources: {'Subnet': ['ID=227d5494-8b2f-4a70-9e77-58d4d0e45746,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:32.647024 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:32.649932 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.658986 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a015e7d-ea70-4ffc-8dc2-879a0f6d3bfa None None] Network 1c714e06-ccca-4a05-8bd6-477318017820 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:27:32.707614 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2399968d-039d-4c05-b7cb-e20cf9b893ac admin admin] 10.222.0.64 "DELETE /v2.0/subnets/227d5494-8b2f-4a70-9e77-58d4d0e45746 HTTP/1.1" status: 204  len: 168 time: 1.2976501
May 20 16:27:32.710180 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38686) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:32.765739 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5d7299d7-0b1d-4194-810c-d0f330902ba8 req-248ca25c-4b0c-4d17-9100-80f1e474ab21 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3243494
May 20 16:27:32.769337 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.841565 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Floating IP f42662cd-89d6-4119-b5eb-8b16bc818fee associated. External IP: 172.27.0.40, port: d8d87b5c-b974-45eb-ae3b-f65255d49ca8.
May 20 16:27:32.910717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.920772 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] DHCP port deletion for 1c714e06-ccca-4a05-8bd6-477318017820 request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:27:32.976391 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.981265 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.988016 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Deleting port 4743695f-0807-4c8d-b272-ace68b5f4b7b {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:32.988680 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:32.998158 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2400148b-f782-481b-844c-f0527b737554 req-1dcbc278-73af-4d9f-b73f-e0295558f85d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:32.999662 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2400148b-f782-481b-844c-f0527b737554 req-1dcbc278-73af-4d9f-b73f-e0295558f85d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.3227837
May 20 16:27:33.057059 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2400148b-f782-481b-844c-f0527b737554 req-59a960a8-73c0-4240-8335-f9f94aef6b13 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0457184
May 20 16:27:33.091061 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] For port 4743695f-0807-4c8d-b272-ace68b5f4b7b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=4743695f-0807-4c8d-b272-ace68b5f4b7b,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:33.091483 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.122139 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.122668 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f9ebaaaf-9e9b-4128-9058-4315baa484e1 {{(pid=92421) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:27:33.141410 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.141410 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-51152e74-dfb9-46e6-9ba5-359c1744de10 admin admin] 10.222.0.64 "DELETE /v2.0/routers/f9ebaaaf-9e9b-4128-9058-4315baa484e1 HTTP/1.1" status: 204  len: 168 time: 2.9908028
May 20 16:27:33.141676 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38690) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:33.150177 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Deleting port 4743695f-0807-4c8d-b272-ace68b5f4b7b {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:33.150523 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.212475 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Deleting subnet bb854cba-1e3d-40b4-a869-9a7d16f7d6a9 {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:27:33.216036 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.217221 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Calling delete_port for 4743695f-0807-4c8d-b272-ace68b5f4b7b owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:33.285842 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.345712 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] For port 4743695f-0807-4c8d-b272-ace68b5f4b7b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=4743695f-0807-4c8d-b272-ace68b5f4b7b,segment=NetworkSegment(6dfff34b-4d7f-4dbe-be5c-23338c108e5f),segment_id=6dfff34b-4d7f-4dbe-be5c-23338c108e5f)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:33.345984 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.346163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.349805 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-4b54ecee-d546-4813-a809-f824b8a10349 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:33.403300 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.433573 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Pushing event deleted for resources: {'Port': ['ID=4743695f-0807-4c8d-b272-ace68b5f4b7b,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:33.442723 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] No DVR routers for this DVR port 4743695f-0807-4c8d-b272-ace68b5f4b7b on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:33.444730 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.445247 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.445426 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.445921 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.446398 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.446731 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.447059 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.447404 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.447730 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.448048 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.448367 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.448679 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:27:33.452228 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9e33cd54-8489-4eb3-bde5-9adc221375a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:33.478005 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Calling delete_port for 4743695f-0807-4c8d-b272-ace68b5f4b7b owned by network:dhcp {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:33.487640 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Router 27c15c4b-53de-4418-8ed7-78ad6d465033 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:33.704132 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 2d91e003-e7a9-4c22-9a99-1564da9f0717 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:33.737054 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 2d91e003-e7a9-4c22-9a99-1564da9f0717 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:33.737398 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 2d91e003-e7a9-4c22-9a99-1564da9f0717 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:33.737810 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 4743695f-0807-4c8d-b272-ace68b5f4b7b no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:33.770204 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 4743695f-0807-4c8d-b272-ace68b5f4b7b {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:33.770550 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 4743695f-0807-4c8d-b272-ace68b5f4b7b not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:33.802498 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.807596 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e0ebb082-7eb6-4370-bb3d-f2b36af6b70b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:33.808246 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.815270 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f8bbc696-a1cb-4abd-9bb3-457485b5c050 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:33.849676 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bb854cba-1e3d-40b4-a869-9a7d16f7d6a9,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:33.849676 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:33.851752 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-234a9f96-c5a5-4d6c-b113-1903953e2b4d None None] Network 3e35d18a-64e2-4e37-8db1-1c472e3454f2 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:27:33.858129 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:33.858129 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-744932c6-7e50-4fbe-98d7-a648dfc869e1 admin admin] 10.222.0.64 "DELETE /v2.0/subnets/bb854cba-1e3d-40b4-a869-9a7d16f7d6a9 HTTP/1.1" status: 204  len: 168 time: 0.7129033
May 20 16:27:33.858129 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38694) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:33.865813 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] No DVR routers for this DVR port 4743695f-0807-4c8d-b272-ace68b5f4b7b on host dv-cinder-689486-13-iscsi {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:33.893316 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:33.902970 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] Sync routers for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:33.904957 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Pushing event deleted for resources: {'Port': ['ID=4743695f-0807-4c8d-b272-ace68b5f4b7b,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:33.914871 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:33.915017 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:33.915860 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712bf81c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:33.972342 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.013480 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.029809 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe7120dda60>,) {'filters': {'network_id': ['1c714e06-ccca-4a05-8bd6-477318017820']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:34.043647 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7120dda60>, '6dfff34b-4d7f-4dbe-be5c-23338c108e5f') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:34.044121 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7120dda60>, '6dfff34b-4d7f-4dbe-be5c-23338c108e5f') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:34.058148 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.074367 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.130112 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.133531 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] DHCP port deletion for 3e35d18a-64e2-4e37-8db1-1c472e3454f2 request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:27:34.137575 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:34.167321 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Releasing vlan 644 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:27:34.167680 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   util.warn(
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   util.warn(
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   util.warn(
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   util.warn(
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:27:34.181650 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:27:34.222967 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] Deleting port ad2f35e3-ad29-49c3-aa78-af3083c41efb {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:34.223373 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.237400 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Deleting port ad2f35e3-ad29-49c3-aa78-af3083c41efb {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:34.238005 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.251806 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3fd4fff2-60b7-47e5-915e-02451024d66f tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "PUT /v2.0/floatingips/f42662cd-89d6-4119-b5eb-8b16bc818fee HTTP/1.1" status: 200  len: 990 time: 2.9894869
May 20 16:27:34.252870 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:34.339434 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.343309 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-56bb111b-d519-432a-b405-1026cc35c105 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:34.352766 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] For port ad2f35e3-ad29-49c3-aa78-af3083c41efb, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ad2f35e3-ad29-49c3-aa78-af3083c41efb,segment=NetworkSegment(5693de47-397e-4e5a-878b-f95a4a1ed194),segment_id=5693de47-397e-4e5a-878b-f95a4a1ed194)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:34.353521 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.376966 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.379518 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Pushing event deleted for resources: {'Network': ['ID=1c714e06-ccca-4a05-8bd6-477318017820,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:34.382602 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:34.427333 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] For port ad2f35e3-ad29-49c3-aa78-af3083c41efb, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ad2f35e3-ad29-49c3-aa78-af3083c41efb,segment=NetworkSegment(5693de47-397e-4e5a-878b-f95a4a1ed194),segment_id=5693de47-397e-4e5a-878b-f95a4a1ed194)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:34.427877 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.447874 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'status': 'completed', 'code': 200}
May 20 16:27:34.469431 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] 10.222.0.64 "DELETE /v2.0/networks/1c714e06-ccca-4a05-8bd6-477318017820 HTTP/1.1" status: 204  len: 168 time: 1.7576935
May 20 16:27:34.470069 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38704) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:34.492326 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] Calling delete_port for ad2f35e3-ad29-49c3-aa78-af3083c41efb owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:34.541136 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712bf81c0>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': 'f42662cd-89d6-4119-b5eb-8b16bc818fee', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'floating_ip_address': '172.27.0.40', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'port_id': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 590, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'mac_address': 'fa:16:3e:87:58:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:05Z', 'updated_at': '2021-05-20T16:27:32Z', 'revision_number': 1, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:34.545640 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] Checking router: 27c15c4b-53de-4418-8ed7-78ad6d465033 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:34.555233 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:34.555839 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712bf81c0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:34.600899 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e1d2a2-ff9d-48dd-a8d4-2a1cf1379141 req-c19e4a72-30b1-4843-95f2-b58f6c53c243 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:34.602419 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07e1d2a2-ff9d-48dd-a8d4-2a1cf1379141 req-c19e4a72-30b1-4843-95f2-b58f6c53c243 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.4014263
May 20 16:27:34.607745 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.610325 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Calling delete_port for ad2f35e3-ad29-49c3-aa78-af3083c41efb owned by network:dhcp {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:34.612983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-fd5f46f9-3223-4335-a377-cc68876d416f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:34.660297 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] Pushing event deleted for resources: {'Port': ['ID=ad2f35e3-ad29-49c3-aa78-af3083c41efb,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:34.664766 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:34.668273 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d36b7d6-939f-4731-9454-6412a573bd90 None None] No DVR routers for this DVR port ad2f35e3-ad29-49c3-aa78-af3083c41efb on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:34.710134 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-07e1d2a2-ff9d-48dd-a8d4-2a1cf1379141 req-f9ad4d1f-d9bd-41de-abe6-5ac9a55d7b4b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0908222
May 20 16:27:34.730516 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-89bef7bf-d5ec-4964-b09e-ddd011ae1a17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:34.732373 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-89bef7bf-d5ec-4964-b09e-ddd011ae1a17 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 1098 time: 0.2251179
May 20 16:27:34.772755 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:34.784087 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:34.794319 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:34.881616 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] No DVR routers for this DVR port ad2f35e3-ad29-49c3-aa78-af3083c41efb on host dv-cinder-689486-13-iscsi {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:34.917892 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Pushing event deleted for resources: {'Port': ['ID=ad2f35e3-ad29-49c3-aa78-af3083c41efb,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:34.920538 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:35.039108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.054308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-86900a70-6a52-4862-a51e-f5ae313acfb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:35.055899 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-86900a70-6a52-4862-a51e-f5ae313acfb3 service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.3109071
May 20 16:27:35.057421 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe711542df0>,) {'filters': {'network_id': ['3e35d18a-64e2-4e37-8db1-1c472e3454f2']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:35.058720 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.123455 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711542df0>, '5693de47-397e-4e5a-878b-f95a4a1ed194') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:35.123914 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711542df0>, '5693de47-397e-4e5a-878b-f95a4a1ed194') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:35.138637 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712bf81c0>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': 'f42662cd-89d6-4119-b5eb-8b16bc818fee', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'floating_ip_address': '172.27.0.40', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'port_id': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 590, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'mac_address': 'fa:16:3e:87:58:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:05Z', 'updated_at': '2021-05-20T16:27:32Z', 'revision_number': 1, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:35.142821 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c297ed32-5630-4e70-a6db-44087d58df22 None None] The sync data for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi is: [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': 'f42662cd-89d6-4119-b5eb-8b16bc818fee', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'floating_ip_address': '172.27.0.40', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'port_id': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 590, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'mac_address': 'fa:16:3e:87:58:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:05Z', 'updated_at': '2021-05-20T16:27:32Z', 'revision_number': 1, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:35.157138 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.187358 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.200000 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Releasing vlan 647 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:27:35.200398 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.215899 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-3faa9d8b-dcea-43e8-8e18-f332dd7df43f service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8 HTTP/1.1" status: 200  len: 998 time: 0.1505744
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   util.warn(
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   util.warn(
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   util.warn(
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   util.warn(
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:27:35.216544 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:27:35.345914 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-cd022871-6f4e-47ff-93db-0ba93a67d5f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:35.347752 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-cd022871-6f4e-47ff-93db-0ba93a67d5f9 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.1185708
May 20 16:27:35.370598 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ca46dad-ac78-47c6-96c7-d4d1654bf3e1 None None] New status for floating IP f42662cd-89d6-4119-b5eb-8b16bc818fee: ACTIVE {{(pid=92423) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:27:35.405678 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.413094 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.418243 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:35.447511 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Pushing event deleted for resources: {'Network': ['ID=3e35d18a-64e2-4e37-8db1-1c472e3454f2,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:35.450164 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:35.453412 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] 10.222.0.64 "DELETE /v2.0/networks/3e35d18a-64e2-4e37-8db1-1c472e3454f2 HTTP/1.1" status: 204  len: 168 time: 1.5938861
May 20 16:27:35.484144 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-d7f40ee1-96fc-4d62-8def-1fb414fccafd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:35.488360 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-d7f40ee1-96fc-4d62-8def-1fb414fccafd service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1325226
May 20 16:27:35.661880 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-bd3ad039-7c6f-474b-8eb6-02f6f2b88c06 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1672211
May 20 16:27:35.700211 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Deleting port c05947f6-99d2-4919-828b-fae8cd15a87b {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:35.700706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.708121 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ad2f35e3-ad29-49c3-aa78-af3083c41efb no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:35.745722 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: ad2f35e3-ad29-49c3-aa78-af3083c41efb {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:35.746197 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ad2f35e3-ad29-49c3-aa78-af3083c41efb not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:35.816741 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-943ad753-4958-48d5-a162-ffb3bbf72779 req-554d1328-ce44-447e-b97d-64e07fac1bd6 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1485159
May 20 16:27:35.837988 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] For port c05947f6-99d2-4919-828b-fae8cd15a87b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=c05947f6-99d2-4919-828b-fae8cd15a87b,segment=NetworkSegment(5d3b33a9-1085-4105-a5b2-b4ebe69df857),segment_id=5d3b33a9-1085-4105-a5b2-b4ebe69df857)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:35.838342 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:35.901846 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38714) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:35.978761 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Calling delete_port for c05947f6-99d2-4919-828b-fae8cd15a87b owned by network:router_interface {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:36.025462 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ba769701-3131-4be6-bcfb-7dfe3609914e admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=b05498ab061b462e9f28e7d5e6bff55e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1224172
May 20 16:27:36.027828 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38718) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:36.031005 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36f49f17-3b94-4863-8355-2f5f0126d84c req-e3737936-66f7-431e-8597-d06829261cb4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:36.033071 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-36f49f17-3b94-4863-8355-2f5f0126d84c req-e3737936-66f7-431e-8597-d06829261cb4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.1872077
May 20 16:27:36.078343 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-36f49f17-3b94-4863-8355-2f5f0126d84c req-8861b344-11c4-495f-9727-53775b3eb0c7 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390699
May 20 16:27:36.105888 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-44a1a5dd-6c1f-4e1b-a472-fd57ffb702ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:36.141425 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-44a1a5dd-6c1f-4e1b-a472-fd57ffb702ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:36.304557 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-44a1a5dd-6c1f-4e1b-a472-fd57ffb702ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:36.308668 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9e84b519-7b7f-4702-83aa-5d203ec0cd7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:36.320896 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a1a5dd-6c1f-4e1b-a472-fd57ffb702ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2a07d3f-5619-4575-b406-cbf01e374aa2,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:36.323753 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-44a1a5dd-6c1f-4e1b-a472-fd57ffb702ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:36.333735 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-44a1a5dd-6c1f-4e1b-a472-fd57ffb702ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:36.334850 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-44a1a5dd-6c1f-4e1b-a472-fd57ffb702ee admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/e2a07d3f-5619-4575-b406-cbf01e374aa2 HTTP/1.1" status: 204  len: 168 time: 0.3061469
May 20 16:27:36.335615 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:36.340287 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f83c3870-552d-4004-ad7d-ae7f3b58b04e tempest-VolumesActionsTest-1047941810 tempest-VolumesActionsTest-1047941810-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:36.384175 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Pushing event deleted for resources: {'Port': ['ID=c05947f6-99d2-4919-828b-fae8cd15a87b,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:36.419038 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:36.656937 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:36.982996 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38728) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:37.039354 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-b354a0a2-f50d-4554-8f8e-31575f9fdaae admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=33df6a8593d344c49044f79e9a65e01f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0508807
May 20 16:27:37.040014 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38732) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:37.102438 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-be9c7fca-7873-4fba-962f-4c408abb7bfb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:37.130289 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-be9c7fca-7873-4fba-962f-4c408abb7bfb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:37.130492 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Router c5f99b4f-9fe9-4916-a604-1236ccbcea58 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:37.260065 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-be9c7fca-7873-4fba-962f-4c408abb7bfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:37.269275 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-18cd481f-9c4c-4adf-9631-fe29000a8458 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:37.282932 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9c7fca-7873-4fba-962f-4c408abb7bfb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=178990bb-0bfb-49a5-bb01-83e3c70cb0ca,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:37.285884 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-be9c7fca-7873-4fba-962f-4c408abb7bfb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:37.287003 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-be9c7fca-7873-4fba-962f-4c408abb7bfb admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/178990bb-0bfb-49a5-bb01-83e3c70cb0ca HTTP/1.1" status: 204  len: 168 time: 0.2464840
May 20 16:27:37.290068 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-be9c7fca-7873-4fba-962f-4c408abb7bfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:37.299679 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525111ea-da8e-484c-9f48-ba0591538e77 req-fd59c0e2-3ed4-4320-8252-6995fb764364 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:37.302716 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-525111ea-da8e-484c-9f48-ba0591538e77 req-fd59c0e2-3ed4-4320-8252-6995fb764364 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.1097965
May 20 16:27:37.357115 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-525111ea-da8e-484c-9f48-ba0591538e77 req-934625e3-885b-4c89-8731-fd9c492ac1c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0501697
May 20 16:27:37.367448 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:37.374723 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-629391fa-7196-4343-a944-9a154aa96798 admin admin] 10.222.0.64 "PUT /v2.0/routers/c5f99b4f-9fe9-4916-a604-1236ccbcea58/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9012961
May 20 16:27:37.378881 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38740) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:37.378974 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] Sync routers for ids ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:37.388627 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] Routers {'c5f99b4f-9fe9-4916-a604-1236ccbcea58'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:37.389548 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7136e9070>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:37.568720 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks [] for router, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:37.586876 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] Set router c5f99b4f-9fe9-4916-a604-1236ccbcea58 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:37.761214 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:37.886245 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7136e9070>, [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': 'abc33861-aeab-4464-8097-834d7603bc27', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:27:36Z', 'revision_number': 5, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port': {'id': 'abc33861-aeab-4464-8097-834d7603bc27', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:68:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:22:59Z', 'updated_at': '2021-05-20T16:23:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:37.890514 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] Checking router: c5f99b4f-9fe9-4916-a604-1236ccbcea58 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:37.900518 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] Routers {'c5f99b4f-9fe9-4916-a604-1236ccbcea58'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:37.901161 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7136e9070>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:37.909941 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Deleting port abc33861-aeab-4464-8097-834d7603bc27 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:37.910604 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.033037 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] For port abc33861-aeab-4464-8097-834d7603bc27, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=abc33861-aeab-4464-8097-834d7603bc27,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:38.045201 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.077456 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] Set router c5f99b4f-9fe9-4916-a604-1236ccbcea58 gateway port host: None {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:38.152997 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Calling delete_port for abc33861-aeab-4464-8097-834d7603bc27 owned by network:router_gateway {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:38.181593 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7136e9070>, [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:27:37Z', 'revision_number': 6, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port_host': None}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:38.185546 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-160fb2ab-1a43-4127-82d7-348e5414b3e0 None None] The sync data for ids ['c5f99b4f-9fe9-4916-a604-1236ccbcea58'] in dv-cinder-689486-13-iscsi is: [{'id': 'c5f99b4f-9fe9-4916-a604-1236ccbcea58', 'name': 'tempest-TestMinimumBasicScenario-109283087-router', 'tenant_id': '47c8c71c28504a48b0c41b67cebe6af8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:22:58Z', 'updated_at': '2021-05-20T16:27:37Z', 'revision_number': 6, 'project_id': '47c8c71c28504a48b0c41b67cebe6af8', 'gw_port_host': None}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:38.373067 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.377517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7c0-efa2-4169-8f9e-50efcd239d91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:38.421190 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Pushing event deleted for resources: {'Port': ['ID=abc33861-aeab-4464-8097-834d7603bc27,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:38.424875 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:38.565184 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.827609 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.831464 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.841629 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f90a73b-4b2e-4ca4-aa13-24b1e75efb1f req-6362ee98-db1d-44b5-b98e-c3718f753a21 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:38.843071 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5f90a73b-4b2e-4ca4-aa13-24b1e75efb1f req-6362ee98-db1d-44b5-b98e-c3718f753a21 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.3604698
May 20 16:27:38.896997 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5f90a73b-4b2e-4ca4-aa13-24b1e75efb1f req-3403bb8f-45d0-427a-83fc-4d2df1d65a1c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0475745
May 20 16:27:38.933508 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.934277 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Fanout notify agent at l3_agent the message router_deleted on router c5f99b4f-9fe9-4916-a604-1236ccbcea58 {{(pid=92421) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:27:38.948250 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] Notify callbacks [] for router, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:38.949390 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-b5af03b7-b2cf-4946-ad92-b860eeda450b admin admin] 10.222.0.64 "DELETE /v2.0/routers/c5f99b4f-9fe9-4916-a604-1236ccbcea58 HTTP/1.1" status: 204  len: 168 time: 1.5728297
May 20 16:27:38.951967 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38750) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:39.016807 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Deleting subnet abe3891f-50c2-4139-bde9-d3bda422e3a4 {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:27:39.019790 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.069920 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.154462 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.453898 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.458517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-af896a8e-9cc4-4103-b371-d5d559608e0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:39.496234 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=abe3891f-50c2-4139-bde9-d3bda422e3a4,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:39.499171 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:39.501512 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.506000 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f75a08b-3b9b-4d50-84a9-7606be43f73d None None] Network c4ec3478-ddb6-4d18-a356-047ead7a15dd requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:27:39.507701 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-4d64b17b-100b-4553-98e4-e350c2f7ff65 admin admin] 10.222.0.64 "DELETE /v2.0/subnets/abe3891f-50c2-4139-bde9-d3bda422e3a4 HTTP/1.1" status: 204  len: 168 time: 0.5547028
May 20 16:27:39.510127 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 38754) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:39.614401 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.688640 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Deleting port a5e8541f-5629-495f-a654-b4eca6ceaafe {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:39.689127 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.707435 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device abc33861-aeab-4464-8097-834d7603bc27 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:39.742202 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: abc33861-aeab-4464-8097-834d7603bc27 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:39.742551 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device abc33861-aeab-4464-8097-834d7603bc27 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:39.742974 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device c05947f6-99d2-4919-828b-fae8cd15a87b no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:39.775156 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] DHCP port deletion for c4ec3478-ddb6-4d18-a356-047ead7a15dd request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:27:39.783795 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: c05947f6-99d2-4919-828b-fae8cd15a87b {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:39.784140 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device c05947f6-99d2-4919-828b-fae8cd15a87b not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:39.792056 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] For port a5e8541f-5629-495f-a654-b4eca6ceaafe, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=a5e8541f-5629-495f-a654-b4eca6ceaafe,segment=NetworkSegment(5d3b33a9-1085-4105-a5b2-b4ebe69df857),segment_id=5d3b33a9-1085-4105-a5b2-b4ebe69df857)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:39.792417 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.842935 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Deleting port a5e8541f-5629-495f-a654-b4eca6ceaafe {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:27:39.843341 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:39.915032 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Calling delete_port for a5e8541f-5629-495f-a654-b4eca6ceaafe owned by network:dhcp {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:39.972624 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] For port a5e8541f-5629-495f-a654-b4eca6ceaafe, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=a5e8541f-5629-495f-a654-b4eca6ceaafe,segment=NetworkSegment(5d3b33a9-1085-4105-a5b2-b4ebe69df857),segment_id=5d3b33a9-1085-4105-a5b2-b4ebe69df857)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:39.972624 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.060137 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.069900 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a5bea4db-9fc5-4d7f-a3db-46da58c2391d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:40.096404 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Calling delete_port for a5e8541f-5629-495f-a654-b4eca6ceaafe owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:27:40.118675 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] No DVR routers for this DVR port a5e8541f-5629-495f-a654-b4eca6ceaafe on host dv-cinder-689486-13-iscsi {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:40.122749 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Pushing event deleted for resources: {'Port': ['ID=a5e8541f-5629-495f-a654-b4eca6ceaafe,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:40.138388 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.142436 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6d912fad-2947-4a4a-8998-4d3de89c578d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:40.152424 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:40.184335 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Pushing event deleted for resources: {'Port': ['ID=a5e8541f-5629-495f-a654-b4eca6ceaafe,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:40.186698 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:40.191164 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] No DVR routers for this DVR port a5e8541f-5629-495f-a654-b4eca6ceaafe on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:27:40.252728 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.270382 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff43a658-1805-458f-9064-ee36e5011836 req-671c5915-45ee-40b6-ae9f-b8e3fcf6bc3a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:40.271900 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff43a658-1805-458f-9064-ee36e5011836 req-671c5915-45ee-40b6-ae9f-b8e3fcf6bc3a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.2584832
May 20 16:27:40.275509 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe7111b2df0>,) {'filters': {'network_id': ['c4ec3478-ddb6-4d18-a356-047ead7a15dd']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:40.304416 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7111b2df0>, '5d3b33a9-1085-4105-a5b2-b4ebe69df857') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:40.304725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7111b2df0>, '5d3b33a9-1085-4105-a5b2-b4ebe69df857') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:40.328766 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.441009 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-ff43a658-1805-458f-9064-ee36e5011836 req-68ff9c4a-dcb9-4db0-b3ff-249bf4dbd066 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1578100
May 20 16:27:40.444362 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.450518 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Releasing vlan 603 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:27:40.450846 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:27:40.464673 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:27:40.584740 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.588415 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:40.600849 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:40.614281 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Pushing event deleted for resources: {'Network': ['ID=c4ec3478-ddb6-4d18-a356-047ead7a15dd,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:40.617222 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:40.619054 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] 10.222.0.64 "DELETE /v2.0/networks/c4ec3478-ddb6-4d18-a356-047ead7a15dd HTTP/1.1" status: 204  len: 168 time: 1.1076593
May 20 16:27:40.964971 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38764) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:41.015965 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5d38910c-dea3-44e8-b4e1-61e51a7c25f0 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=8614158322ae423bb16b1c0645c66cf9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0497622
May 20 16:27:41.018255 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38768) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:41.073666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:41.099163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:41.230839 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:41.236015 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-26a9acc3-05e0-41c5-a18c-2de4c4d003bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:41.246116 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62841583-ef69-4bd6-9ba1-a6118731c4d9,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:41.249515 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:41.253291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:41.255451 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/62841583-ef69-4bd6-9ba1-a6118731c4d9 HTTP/1.1" status: 204  len: 168 time: 0.2353995
May 20 16:27:41.633039 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c850a56-1b49-4202-8b95-f04dac1fb0a6 req-e20ecb7d-cf77-4627-8e22-f29ff083bf6d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:41.634537 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7c850a56-1b49-4202-8b95-f04dac1fb0a6 req-e20ecb7d-cf77-4627-8e22-f29ff083bf6d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.0882268
May 20 16:27:41.680179 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7c850a56-1b49-4202-8b95-f04dac1fb0a6 req-bf342d1a-9289-42c1-8a3e-a0b3af8aaef0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397596
May 20 16:27:41.703028 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device a5e8541f-5629-495f-a654-b4eca6ceaafe no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:27:41.737112 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: a5e8541f-5629-495f-a654-b4eca6ceaafe {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:27:41.737468 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device a5e8541f-5629-495f-a654-b4eca6ceaafe not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:27:42.102122 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38780) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:42.152322 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-c6d2e2df-df95-4517-b46b-866779c801ce admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=47c8c71c28504a48b0c41b67cebe6af8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0490260
May 20 16:27:42.154647 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38784) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:42.213340 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:42.239129 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:42.350480 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:42.354563 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-453e3f1e-cd4b-4659-8250-ec9c4b48cd9f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:42.366288 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f56cdef3-5121-4f41-94c0-b67f71d82e31,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:42.368582 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:42.375705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:42.375969 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/f56cdef3-5121-4f41-94c0-b67f71d82e31 HTTP/1.1" status: 204  len: 168 time: 0.2203739
May 20 16:27:42.886510 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da37e23f-7cf9-4464-af3f-e5bd5fcee075 req-25235e8b-98a7-4d7d-9c59-1bd49892e209 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:42.887901 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-da37e23f-7cf9-4464-af3f-e5bd5fcee075 req-25235e8b-98a7-4d7d-9c59-1bd49892e209 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 943 time: 0.0865188
May 20 16:27:42.931771 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-da37e23f-7cf9-4464-af3f-e5bd5fcee075 req-1118647c-4823-4e17-893d-8705bda9a463 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381682
May 20 16:27:43.252455 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:27:43.383266 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:43.396945 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 637, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:27:43.455457 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:43.471972 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:27:43.488244 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:43.590632 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:43.593057 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:43.657826 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:43.660786 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:43.938478 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['5ac737cf-18db-4859-93ae-3ce4c7a6e5c9'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:27:44.113033 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a50913-7c20-4c61-9d9d-cffd4d68fed9 req-28e9860c-c645-4dab-b424-68c408684dce tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:44.114506 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-11a50913-7c20-4c61-9d9d-cffd4d68fed9 req-28e9860c-c645-4dab-b424-68c408684dce tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 944 time: 0.0801907
May 20 16:27:44.158760 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-11a50913-7c20-4c61-9d9d-cffd4d68fed9 req-2a6560a6-1b31-4008-b911-e2aac99475d4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383663
May 20 16:27:45.286090 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:27:45.345799 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815c5e2a-0fa5-4c20-86b4-2b6eb30d6c1f req-4bc38332-1941-4f2f-8c87-17767bbf850a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:45.347294 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-815c5e2a-0fa5-4c20-86b4-2b6eb30d6c1f req-4bc38332-1941-4f2f-8c87-17767bbf850a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 944 time: 0.0832343
May 20 16:27:45.393108 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-815c5e2a-0fa5-4c20-86b4-2b6eb30d6c1f req-cf14b945-a543-4db5-89a5-a6b9f1e158c8 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399556
May 20 16:27:45.413084 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:27:45.417992 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:27:45.450787 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:45.533012 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:45.559066 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:45.569322 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:27:45.609733 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'code': 200}
May 20 16:27:45.642121 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:45.644963 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-32693adc-07cd-4b55-9331-c22bce44df46 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:45.712667 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:45.715482 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:45.881927 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-86c7e1f0-70b0-4e45-af1b-f3f9b3d699bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:46.021946 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffd3f63-0472-439b-8e9a-7997b88544e5 req-b19484cc-6f3a-4045-a811-d354ae2f2db7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:46.023367 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8ffd3f63-0472-439b-8e9a-7997b88544e5 req-b19484cc-6f3a-4045-a811-d354ae2f2db7 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1098 time: 0.0708745
May 20 16:27:46.067696 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8ffd3f63-0472-439b-8e9a-7997b88544e5 req-76bf0711-0691-4a04-aa69-74285bbbad08 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377829
May 20 16:27:46.579051 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c486f09d-ae83-4314-9cc5-a20624a5e1be req-051b434b-3809-4a6e-816c-7c30e0ba5d6b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:46.580539 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c486f09d-ae83-4314-9cc5-a20624a5e1be req-051b434b-3809-4a6e-816c-7c30e0ba5d6b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 945 time: 0.0782640
May 20 16:27:46.622960 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c486f09d-ae83-4314-9cc5-a20624a5e1be req-1867c326-cca6-431c-812e-5443250a16c6 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0368309
May 20 16:27:47.808884 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-688140af-c64d-4e6a-9968-647e98ca5a87 req-f733d5e6-1cb6-468b-a05f-95190bd4f5a3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:47.810303 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-688140af-c64d-4e6a-9968-647e98ca5a87 req-f733d5e6-1cb6-468b-a05f-95190bd4f5a3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 945 time: 0.0811548
May 20 16:27:47.855077 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-688140af-c64d-4e6a-9968-647e98ca5a87 req-68692e11-be60-44bb-ae78-a97d0ca27718 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388796
May 20 16:27:48.036215 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226c22e4-426c-4e5e-b1ce-c83e061c7877 req-af5bcbb8-ff86-4ed1-b177-45fc09b637e1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:48.037671 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-226c22e4-426c-4e5e-b1ce-c83e061c7877 req-af5bcbb8-ff86-4ed1-b177-45fc09b637e1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 945 time: 0.0799749
May 20 16:27:48.082437 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-226c22e4-426c-4e5e-b1ce-c83e061c7877 req-1a7cf721-0e24-4845-9536-b5c804a617d7 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390558
May 20 16:27:48.104793 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38818) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:48.174611 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-581e26bb-090e-4b60-92ec-3b626b35c37e tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:48.175348 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-581e26bb-090e-4b60-92ec-3b626b35c37e tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] Synchronizing usage tracker for tenant:3c8d0c7d5c7f420f878c3ea95df7af77 on resource:port {{(pid=92422) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:27:48.264517 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-581e26bb-090e-4b60-92ec-3b626b35c37e tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] Unset dirty status for tenant:3c8d0c7d5c7f420f878c3ea95df7af77 on resource:port {{(pid=92422) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:27:48.265699 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-581e26bb-090e-4b60-92ec-3b626b35c37e tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1093 time: 0.1599538
May 20 16:27:48.268444 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38822) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:27:48.273481 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.v2.base [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address': '172.20.0.4'}} {{(pid=92422) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:27:48.280023 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:27:48.283116 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:floatingip and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:27:48.285949 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:27:48.291553 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:27:48.361758 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:48.495090 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:48.522038 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:48.630575 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_common [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Allocated IP 172.27.0.179 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/a3882e96-332a-4c5a-b86e-e105d3e44a16) {{(pid=92422) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:27:48.704588 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87357491-1ae4-4b60-8cfe-9dc3b653a328 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:48.772678 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:48.876132 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:48.880451 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-53b41b7c-9473-4d86-b454-13a42fe771a8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:48.943334 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92422) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:27:48.946173 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.base_scheduler [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources bound (agent type, host, resource id):  {{(pid=92422) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:27:48.949840 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Received port after_create {{(pid=92422) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:27:48.986882 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=a3882e96-332a-4c5a-b86e-e105d3e44a16,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:48.994458 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:49.356708 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:49.505107 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:49.658854 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:49.807538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:49.847111 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6359019'] for port, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:49.851599 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2920bdfb-e03e-43d0-87df-4bc5d9726ce0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:27:49.949099 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=a3882e96-332a-4c5a-b86e-e105d3e44a16,revision_number=2']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:27:49.953069 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:27:49.961177 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:50.127762 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Floating IP 8eb78320-222d-470c-97be-892e78e1e72e associated. External IP: 172.27.0.179, port: 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9.
May 20 16:27:50.464730 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:27:50.639853 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:27:50.649571 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:27:50.659657 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:50.660265 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711bef910>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:50.738973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:50.794466 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.5248599
May 20 16:27:50.795214 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:27:50.838320 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:50.842258 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'status': 'completed', 'code': 200}
May 20 16:27:50.939113 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-ea3dbb2c-ed48-44d1-85a7-1a551d09c199 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:50.940522 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-ea3dbb2c-ed48-44d1-85a7-1a551d09c199 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1098 time: 0.0727909
May 20 16:27:51.075107 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-31cdb634-6034-4a99-b084-e3e5b5e9fac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:51.076586 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-31cdb634-6034-4a99-b084-e3e5b5e9fac3 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.1289394
May 20 16:27:51.180126 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-03276492-7d82-4720-a9ae-a0d5f3330052 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 200  len: 999 time: 0.0960159
May 20 16:27:51.232351 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711bef910>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:49Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:51.237078 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:27:51.245091 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-851cd90c-d7ab-4601-a4ba-fbfabc3682a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:51.246409 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:27:51.246536 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-851cd90c-d7ab-4601-a4ba-fbfabc3682a0 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0600641
May 20 16:27:51.247008 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711bef910>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:27:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:51.305310 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:27:51.328172 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-706eae52-668a-479f-b510-44a3e88f83ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:27:51.329656 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-706eae52-668a-479f-b510-44a3e88f83ac service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0759826
May 20 16:27:51.430695 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:27:51.465944 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-2516d4cf-fc06-424a-91e1-803fdb7c288d service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1290512
May 20 16:27:51.695731 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-354f55a2-475b-4e6e-84bc-1dd52bc3983f req-e85d3579-199b-43f5-a8d0-1a81aff35e9b service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2165191
May 20 16:27:51.778047 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711bef910>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:49Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:27:51.782104 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-393f365b-a755-482e-bc43-b354b47ce362 None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:49Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:27:51.955916 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b8eb5b9-20c2-45c4-9bfe-9ce9b8d524f9 None None] New status for floating IP 8eb78320-222d-470c-97be-892e78e1e72e: ACTIVE {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:27:59.338556 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:00.960902 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:28:02.043145 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-6e945cf5-14f7-4aa5-a0e3-e467f712f8c3 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0700166
May 20 16:28:02.184538 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-5d76932e-644d-4e4e-ac1b-6b6568b5db47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:28:02.186011 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-5d76932e-644d-4e4e-ac1b-6b6568b5db47 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 1099 time: 0.0746644
May 20 16:28:02.331535 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-f639d81c-72b6-4da9-bb8f-35be9ed925f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:28:02.332962 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-f639d81c-72b6-4da9-bb8f-35be9ed925f9 service neutron] 10.222.0.16 "GET /v2.0/networks?id=77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 200  len: 918 time: 0.1281533
May 20 16:28:02.432760 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-d253d4dc-2936-47a9-bcba-5dbcfe117870 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=224f3f0d-380f-45af-8889-4430982438fe HTTP/1.1" status: 200  len: 1000 time: 0.0933297
May 20 16:28:02.499421 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-20dc1420-e095-4469-823b-2423e1f22217 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:28:02.501437 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-20dc1420-e095-4469-823b-2423e1f22217 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 200  len: 856 time: 0.0619586
May 20 16:28:02.576603 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-21a5d265-131e-4452-9965-9e448bf63628 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:28:02.578124 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-21a5d265-131e-4452-9965-9e448bf63628 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=77fd2be7-62d4-4a17-a108-9198b949900a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0708938
May 20 16:28:02.711468 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-3eb625fd-60ee-4127-bcdc-30df40b892eb service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1259882
May 20 16:28:02.843921 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-824f9526-8192-4b42-bf45-52b9c3d4e569 req-54fea00a-ac4b-45df-84e2-328c25cada0f service neutron] 10.222.0.16 "GET /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1266077
May 20 16:28:15.932772 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-2be510d7-733a-48ab-a928-f105b425272a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:18.447154 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:18.641393 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-01878005-4272-47de-8256-a4121262eb10 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:19.697739 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:21.327404 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:29.361258 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:30.927605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2eae18-7ad2-4a51-83d8-eb29f4ecb3a2 req-27a701d5-55aa-4c2c-9361-686cd7237c90 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:28:30.928992 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0d2eae18-7ad2-4a51-83d8-eb29f4ecb3a2 req-27a701d5-55aa-4c2c-9361-686cd7237c90 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 946 time: 0.0832736
May 20 16:28:30.972760 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-0d2eae18-7ad2-4a51-83d8-eb29f4ecb3a2 req-043226d3-add8-4e51-bdfc-954bbfc1a924 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0373735
May 20 16:28:32.163500 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c7526df-35f8-484f-be37-2e667a5d03fc req-99fd510c-d49f-482f-8032-3576ee82b0af tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:28:32.164971 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6c7526df-35f8-484f-be37-2e667a5d03fc req-99fd510c-d49f-482f-8032-3576ee82b0af tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 946 time: 0.0806456
May 20 16:28:32.212120 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6c7526df-35f8-484f-be37-2e667a5d03fc req-c27dcea0-54ad-4807-ae2f-74c13f11dd69 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups?id=b44e7715-c706-45ed-ab9e-1a903e12abd0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415254
May 20 16:28:32.494053 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b07f7a28-303d-4e71-9c4f-b7411d85aa74 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:28:32.495532 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b07f7a28-303d-4e71-9c4f-b7411d85aa74 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 946 time: 0.0780909
May 20 16:28:32.627807 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Deleting port 224f3f0d-380f-45af-8889-4430982438fe {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:28:32.628151 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:32.758946 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] For port 224f3f0d-380f-45af-8889-4430982438fe, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=224f3f0d-380f-45af-8889-4430982438fe,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:28:32.759325 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:33.126255 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:33.126624 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:33.126937 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Floating IP 95418600-8ffa-46a1-bb0e-4982935c0ab2 disassociated. External IP: 172.27.0.66, port: 224f3f0d-380f-45af-8889-4430982438fe.
May 20 16:28:33.127308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Calling delete_port for 224f3f0d-380f-45af-8889-4430982438fe owned by compute:nova {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:28:33.304409 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:33.310377 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a54ca59d-47bf-4234-a885-9620509303ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:33.387743 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event deleted for resources: {'Port': ['ID=224f3f0d-380f-45af-8889-4430982438fe,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:33.407231 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.407611 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.407986 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.408357 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.408725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.409083 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.409440 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.409806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.410161 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.410513 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.468585 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.468585 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:33.468585 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5a93f079-5901-480f-a614-ba6e8f8e1f8d req-66f990a8-03e2-4bfa-8342-f2ef3df03104 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 210 time: 0.0695090
May 20 16:28:33.468585 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:33.598766 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Router 7ca2542d-958b-4848-b460-42f1d2b2dd11 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:28:33.777749 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:28:33.787687 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] Sync routers for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:28:33.798092 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:28:33.798996 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7125f30a0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:28:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:33.855416 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] No DVR routers for this DVR port 224f3f0d-380f-45af-8889-4430982438fe on host hv-cinder-68948 {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:28:33.858073 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:33.860917 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-deleted', 'tag': '224f3f0d-380f-45af-8889-4430982438fe'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:28:33.909243 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7a48945-6cb3-4ae1-aa65-86bfcbc2677a', 'name': 'network-vif-deleted', 'tag': '224f3f0d-380f-45af-8889-4430982438fe', 'status': 'completed', 'code': 200}
May 20 16:28:33.928093 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c5ace01a-97d5-4d36-9885-6491481527a5 req-b1df060c-9a52-4ffd-88fa-52e9e975ae15 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.16 "DELETE /v2.0/ports/224f3f0d-380f-45af-8889-4430982438fe HTTP/1.1" status: 204  len: 173 time: 1.4275107
May 20 16:28:33.982403 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:28:34.332849 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7125f30a0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:34.337066 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] Checking router: 7ca2542d-958b-4848-b460-42f1d2b2dd11 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:28:34.345018 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:28:34.345625 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7125f30a0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:28:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:34.516706 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:28:34.588473 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-20016748-a908-4c48-8b85-84ba37d2f479 req-e24dad3e-2e53-4fe7-aca0-752ca08a83e8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Synchronizing usage tracker for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:28:34.709922 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-20016748-a908-4c48-8b85-84ba37d2f479 req-e24dad3e-2e53-4fe7-aca0-752ca08a83e8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Unset dirty status for tenant:ddfbe809b7ae4afba7cc3bc0c9fc5984 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:28:34.711095 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-20016748-a908-4c48-8b85-84ba37d2f479 req-e24dad3e-2e53-4fe7-aca0-752ca08a83e8 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/ports?device_id=c7a48945-6cb3-4ae1-aa65-86bfcbc2677a HTTP/1.1" status: 200  len: 210 time: 0.1676111
May 20 16:28:34.825657 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7125f30a0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:34.829697 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72195a9c-771c-4bb4-a344-7fdafac57b9d None None] The sync data for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi is: [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:16:44Z', 'revision_number': 4, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '651066cd-47a2-415a-8605-8ad19ef01cb4', 'name': '', 'network_id': '77fd2be7-62d4-4a17-a108-9198b949900a', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'mac_address': 'fa:16:3e:a3:a5:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:43Z', 'updated_at': '2021-05-20T16:16:57Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'subnets': [{'id': 'aa2b66ba-5130-41c9-9666-93c8e6eedee4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:28:35.026756 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dda323a-5095-4cfc-aab7-f205c013a651 None None] New status for floating IP 95418600-8ffa-46a1-bb0e-4982935c0ab2: DOWN {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:28:35.897017 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38956) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:35.961042 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:35.992032 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:36.127095 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:36.130945 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7e434545-abea-4ae3-9f1a-77f9e26a9482 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:36.146670 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b44e7715-c706-45ed-ab9e-1a903e12abd0,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:36.157988 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.158372 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.158751 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.159123 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.159516 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.159886 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.160296 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.160659 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.161021 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.161381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.161739 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.162095 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:36.165196 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:36.166297 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "DELETE /v2.0/security-groups/b44e7715-c706-45ed-ab9e-1a903e12abd0 HTTP/1.1" status: 204  len: 168 time: 0.2683287
May 20 16:28:36.167192 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-48332e61-9c03-4e88-adcb-d45f8f14ddd7 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:36.168999 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38960) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:36.185740 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.api.v2.resource [None req-d3452ed6-804e-4a92-895a-945b0ddc076a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] show failed (client error): The resource could not be found.
May 20 16:28:36.186738 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d3452ed6-804e-4a92-895a-945b0ddc076a tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "GET /v2.0/security-groups/b44e7715-c706-45ed-ab9e-1a903e12abd0 HTTP/1.1" status: 404  len: 347 time: 0.0168538
May 20 16:28:36.189560 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38964) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:36.507079 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Deleting port 7c457a03-db12-4579-b231-6be6d9b4e358 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:28:36.507366 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:36.621773 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:36.622098 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:36.741886 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Calling delete_port for 7c457a03-db12-4579-b231-6be6d9b4e358 owned by network:floatingip {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:28:36.932702 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:36.937086 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3ca6a4d8-8a77-4c05-86c2-6b56fe5b8be9 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:36.983338 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Pushing event deleted for resources: {'Port': ['ID=7c457a03-db12-4579-b231-6be6d9b4e358,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:37.008679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:37.069345 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks [] for floatingip, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:37.143058 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:37.144492 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-24f4e0d5-3804-4dcc-9cf2-2d2739c857c1 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] 10.222.0.64 "DELETE /v2.0/floatingips/95418600-8ffa-46a1-bb0e-4982935c0ab2 HTTP/1.1" status: 204  len: 168 time: 0.9537947
May 20 16:28:37.520550 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:28:37.558309 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 224f3f0d-380f-45af-8889-4430982438fe {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:28:37.573231 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 224f3f0d-380f-45af-8889-4430982438fe not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:28:37.958910 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:28:40.275973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 38996) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:41.003718 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:41.493601 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Deleting port 651066cd-47a2-415a-8605-8ad19ef01cb4 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:28:41.494318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:41.610209 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] For port 651066cd-47a2-415a-8605-8ad19ef01cb4, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=651066cd-47a2-415a-8605-8ad19ef01cb4,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:28:41.610558 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:41.729666 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Calling delete_port for 651066cd-47a2-415a-8605-8ad19ef01cb4 owned by network:router_interface {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:28:41.944367 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:41.948278 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3d8518fb-85e5-4b98-bf15-5d59c1a95b47 tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:41.992549 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Pushing event deleted for resources: {'Port': ['ID=651066cd-47a2-415a-8605-8ad19ef01cb4,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:41.996163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:42.254763 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:42.598564 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Router 7ca2542d-958b-4848-b460-42f1d2b2dd11 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:28:42.876094 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:28:42.884393 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] Sync routers for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:28:42.887831 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] 10.222.0.64 "PUT /v2.0/routers/7ca2542d-958b-4848-b460-42f1d2b2dd11/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6107683
May 20 16:28:42.890286 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39008) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:42.893774 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:28:42.894422 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7124b70d0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:28:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:43.064673 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks [] for router, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:43.071668 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:28:43.249251 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:43.367541 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7124b70d0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156'}], 'enable_snat': True}, 'gw_port_id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:28:41Z', 'revision_number': 5, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port': {'id': '7f5d614c-c347-4c74-a29d-8f8c4b8ae27f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:10:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:16:39Z', 'updated_at': '2021-05-20T16:16:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:43.371277 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] Checking router: 7ca2542d-958b-4848-b460-42f1d2b2dd11 for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:28:43.379449 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] Routers {'7ca2542d-958b-4848-b460-42f1d2b2dd11'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:28:43.380075 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe7124b70d0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:28:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['7ca2542d-958b-4848-b460-42f1d2b2dd11'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:43.481205 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Deleting port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:28:43.481551 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:43.564079 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] Set router 7ca2542d-958b-4848-b460-42f1d2b2dd11 gateway port host: None {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:28:43.604453 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] For port 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:28:43.605069 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:43.671690 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe7124b70d0>, [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:28:43Z', 'revision_number': 6, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port_host': None}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:43.675750 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9109d0c-a187-4995-b685-d592ee232af2 None None] The sync data for ids ['7ca2542d-958b-4848-b460-42f1d2b2dd11'] in dv-cinder-689486-13-iscsi is: [{'id': '7ca2542d-958b-4848-b460-42f1d2b2dd11', 'name': 'tempest-AttachVolumeShelveTestJSON-1639066828-router', 'tenant_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:16:37Z', 'updated_at': '2021-05-20T16:28:43Z', 'revision_number': 6, 'project_id': 'ddfbe809b7ae4afba7cc3bc0c9fc5984', 'gw_port_host': None}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:28:43.732712 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Calling delete_port for 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f owned by network:router_gateway {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:28:43.926788 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:43.931925 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-49fe5620-69ee-4734-9968-99c996f27217 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:44.002249 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Pushing event deleted for resources: {'Port': ['ID=7f5d614c-c347-4c74-a29d-8f8c4b8ae27f,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:44.004542 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:44.071852 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.245654 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.247850 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.326702 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.327379 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7ca2542d-958b-4848-b460-42f1d2b2dd11 {{(pid=92422) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:28:44.339943 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.342463 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-06c6e37e-8f6e-4eda-b43b-ee4f372252a8 admin admin] 10.222.0.64 "DELETE /v2.0/routers/7ca2542d-958b-4848-b460-42f1d2b2dd11 HTTP/1.1" status: 204  len: 168 time: 1.4498746
May 20 16:28:44.343527 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39016) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:44.407060 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_v2 [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Deleting subnet aa2b66ba-5130-41c9-9666-93c8e6eedee4 {{(pid=92422) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:28:44.410094 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.459611 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6219245'] for subnet, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.536082 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.954436 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6358801', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6223409'] for subnet, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:44.959302 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-944e95b4-759e-4421-95e6-9f4a1fc18db8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:44.995637 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aa2b66ba-5130-41c9-9666-93c8e6eedee4,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:44.998570 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:44.999600 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.005032 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1abbc53f-a28b-485c-9f44-faad4b65ab2a None None] Network 77fd2be7-62d4-4a17-a108-9198b949900a requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:28:45.005986 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d39417a8-a578-425b-95d0-51d14d840d5d admin admin] 10.222.0.64 "DELETE /v2.0/subnets/aa2b66ba-5130-41c9-9666-93c8e6eedee4 HTTP/1.1" status: 204  len: 168 time: 0.6614497
May 20 16:28:45.008983 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39020) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:45.113772 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.184550 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Deleting port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:28:45.184892 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.264071 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] DHCP port deletion for 77fd2be7-62d4-4a17-a108-9198b949900a request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:28:45.297325 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] For port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:28:45.297778 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.328760 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Deleting port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:28:45.329187 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.419441 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Calling delete_port for 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 owned by network:dhcp {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:28:45.428287 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] For port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,segment=NetworkSegment(c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a),segment_id=c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:28:45.428690 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.551392 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Calling delete_port for 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:28:45.572958 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.577777 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6f4924fa-9550-428a-a99b-46165d49948a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:45.594205 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.597679 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:45.622347 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:45.628282 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:45.631346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] No DVR routers for this DVR port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 on host dv-cinder-689486-13-iscsi {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:28:45.640626 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Pushing event deleted for resources: {'Port': ['ID=27716f20-a4f5-40a5-9890-58a4c8e3f6e9,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:45.645340 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] No DVR routers for this DVR port 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:28:45.651342 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.651696 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.652034 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.652365 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.652695 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.653022 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.653348 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.653672 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.653995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.654316 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.654635 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.654953 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:28:45.657825 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-120ab503-8821-4c81-a6b1-ed57646f5eb9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:45.732307 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:28:45.750431 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.763993 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe7110a7670>,) {'filters': {'network_id': ['77fd2be7-62d4-4a17-a108-9198b949900a']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:45.766711 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:28:45.767065 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 27716f20-a4f5-40a5-9890-58a4c8e3f6e9 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:28:45.767516 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 651066cd-47a2-415a-8605-8ad19ef01cb4 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:28:45.775838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7110a7670>, 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:45.776128 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7110a7670>, 'c346e51d-f2cb-4a4a-a3f1-b4c40d9cb90a') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:28:45.787109 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.803312 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 651066cd-47a2-415a-8605-8ad19ef01cb4 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:28:45.803628 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 651066cd-47a2-415a-8605-8ad19ef01cb4 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:28:45.803745 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.804047 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:28:45.811415 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Releasing vlan 609 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:28:45.811806 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:28:45.824741 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:28:45.843027 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:28:45.843402 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 7f5d614c-c347-4c74-a29d-8f8c4b8ae27f not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:28:45.903830 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c67de600-4822-4338-b0cb-06ad651d8357 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.983801 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.988301 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:45.990658 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:46.012750 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Pushing event deleted for resources: {'Network': ['ID=77fd2be7-62d4-4a17-a108-9198b949900a,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:46.015071 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:46.087655 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] 10.222.0.64 "DELETE /v2.0/networks/77fd2be7-62d4-4a17-a108-9198b949900a HTTP/1.1" status: 204  len: 168 time: 1.0775344
May 20 16:28:46.354106 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39030) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:46.404040 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2d179421-beb9-439b-b0f3-945c90861600 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=ddfbe809b7ae4afba7cc3bc0c9fc5984&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0484529
May 20 16:28:46.406375 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39034) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:46.464918 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:46.490856 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:46.599515 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:46.604429 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d243217-be45-4b60-b10d-2604b02b6998 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:46.622761 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=215960a6-1bf1-42c7-bd2e-19649f92faf7,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:46.625615 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:46.627597 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:46.628619 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/215960a6-1bf1-42c7-bd2e-19649f92faf7 HTTP/1.1" status: 204  len: 168 time: 0.2213578
May 20 16:28:48.441432 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:48.685372 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9b00c604-3543-4401-bde1-80c0579dd15e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:49.639787 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:51.298508 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:51.948628 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39178) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:52.066121 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:52.080164 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:28:52.083898 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Usage tracker for resource:security_group_rule and tenant:5eaa1c292bef4b7db657c9f6ffb6ffb9 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:28:52.086691 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:28:52.092400 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:28:52.174125 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:52.264207 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:52.271416 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-f8f620cb-def3-4932-ba1b-8bd9b037a2ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:52.316499 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=5eaa1c292bef4b7db657c9f6ffb6ffb9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3664768
May 20 16:28:52.317400 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=963dec4e-8688-4d79-ae0d-57e75edba77e,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:52.319304 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39186) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:52.320495 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:52.377773 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1b3f8ce8-827b-4e1f-8765-8f0ed291eea4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:52.403115 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1b3f8ce8-827b-4e1f-8765-8f0ed291eea4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:52.532712 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1b3f8ce8-827b-4e1f-8765-8f0ed291eea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:52.537376 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b055c468-fb83-4772-9485-0db25e8f810d tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:52.549942 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3f8ce8-827b-4e1f-8765-8f0ed291eea4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=963dec4e-8688-4d79-ae0d-57e75edba77e,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:52.553113 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1b3f8ce8-827b-4e1f-8765-8f0ed291eea4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:52.553693 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1b3f8ce8-827b-4e1f-8765-8f0ed291eea4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:52.555393 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1b3f8ce8-827b-4e1f-8765-8f0ed291eea4 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/963dec4e-8688-4d79-ae0d-57e75edba77e HTTP/1.1" status: 204  len: 168 time: 0.2350512
May 20 16:28:53.269679 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39196) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:53.285549 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:53.299880 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:28:53.303682 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Usage tracker for resource:security_group_rule and tenant:de4fee9b8b474672a6508dd5a0f99ec8 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:28:53.306412 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:28:53.312676 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:28:53.390149 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:53.503529 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:53.512013 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-20884724-e521-4031-a780-0b118db1304e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:53.552411 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=de4fee9b8b474672a6508dd5a0f99ec8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2835641
May 20 16:28:53.553318 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57646481-2436-400d-862c-ac72a23c5e85,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:53.555151 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39200) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:53.556375 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:53.614546 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:53.640399 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:53.761016 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:53.764656 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5e4127e8-91e6-4dee-9827-66bda8ee7761 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:53.775709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57646481-2436-400d-862c-ac72a23c5e85,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:53.777927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:53.782721 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:53.783870 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/57646481-2436-400d-862c-ac72a23c5e85 HTTP/1.1" status: 204  len: 168 time: 0.2276754
May 20 16:28:58.079011 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39294) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:58.194241 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:58.208854 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:28:58.212670 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Usage tracker for resource:security_group_rule and tenant:c8bf926b29904a14af520cab7fdf1be6 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:28:58.215545 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:28:58.221091 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:28:58.303837 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:58.412487 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:58.420636 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5c20eb5b-e81b-4c3b-8844-9a9002d3c5b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:58.460008 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=c8bf926b29904a14af520cab7fdf1be6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3798676
May 20 16:28:58.461659 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba270cae-d3c4-4f17-b1cb-00d358d9329c,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:58.462806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39302) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:58.464644 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-29ce5d68-5c18-4df3-8322-832e5aeb84ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:58.532292 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a7e8b579-428f-44a9-81d9-c79e97178f03 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:58.561241 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a7e8b579-428f-44a9-81d9-c79e97178f03 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:58.720954 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a7e8b579-428f-44a9-81d9-c79e97178f03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:58.725443 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e9bfd579-b3eb-4eb2-b4b4-0dea0e470b08 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:58.738151 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e8b579-428f-44a9-81d9-c79e97178f03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba270cae-d3c4-4f17-b1cb-00d358d9329c,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:58.740702 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-a7e8b579-428f-44a9-81d9-c79e97178f03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:58.750506 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-a7e8b579-428f-44a9-81d9-c79e97178f03 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:58.751674 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-a7e8b579-428f-44a9-81d9-c79e97178f03 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/ba270cae-d3c4-4f17-b1cb-00d358d9329c HTTP/1.1" status: 204  len: 168 time: 0.2849693
May 20 16:28:59.366790 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:59.410149 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39310) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:59.428738 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:59.443094 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:28:59.446898 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Usage tracker for resource:security_group_rule and tenant:579ed4d92f024ce39618b57950a98c22 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:28:59.449776 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:28:59.455680 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:28:59.537383 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:59.612173 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:59.621021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d3953450-2f4e-45aa-8dda-67c13d6fb2a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:28:59.660685 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=579ed4d92f024ce39618b57950a98c22&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2494962
May 20 16:28:59.662397 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=898a1405-ed55-4b5f-b358-2efcab416aaa,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:28:59.663409 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39316) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:28:59.665527 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:28:59.721771 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:59.749653 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:59.989831 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:28:59.994505 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-40a52b81-6149-4a16-927a-ec00fc7207a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:00.006565 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=898a1405-ed55-4b5f-b358-2efcab416aaa,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:00.008758 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:00.017419 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:00.018686 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/898a1405-ed55-4b5f-b358-2efcab416aaa HTTP/1.1" status: 204  len: 168 time: 0.3543158
May 20 16:29:01.767065 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39354) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:01.882903 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:01.896670 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:29:01.900407 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Usage tracker for resource:security_group_rule and tenant:668a6fbdbaba407db15c71b36e86c968 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:29:01.903173 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:29:01.908856 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:29:01.986564 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:02.084899 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:02.091887 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7d39be99-e068-4692-bdc9-45be407d1402 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:02.133269 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=668a6fbdbaba407db15c71b36e86c968&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3650990
May 20 16:29:02.134256 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5fd215a-6604-4f7c-b96f-635911dfe139,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:02.135993 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39360) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:02.137398 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e438dbbb-34dc-44ed-8e5e-f28500e2b16d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:02.199661 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4e7619cc-96b9-4213-bc74-41d06897f2bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:02.224514 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4e7619cc-96b9-4213-bc74-41d06897f2bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:02.347114 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4e7619cc-96b9-4213-bc74-41d06897f2bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:02.350781 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1dd7460c-8d5d-4edf-a98f-c09425f57858 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:02.363514 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e7619cc-96b9-4213-bc74-41d06897f2bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5fd215a-6604-4f7c-b96f-635911dfe139,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:02.366030 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4e7619cc-96b9-4213-bc74-41d06897f2bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:02.373249 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-4e7619cc-96b9-4213-bc74-41d06897f2bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:02.374350 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-4e7619cc-96b9-4213-bc74-41d06897f2bc admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/d5fd215a-6604-4f7c-b96f-635911dfe139 HTTP/1.1" status: 204  len: 168 time: 0.2366560
May 20 16:29:03.081787 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-44de44b4-3b39-4c9f-b222-1e8ab6294e7b service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0701053
May 20 16:29:03.175854 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-2ad62940-70a0-4d71-9652-593caea775e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:03.177314 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-2ad62940-70a0-4d71-9652-593caea775e9 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d01080acc33f4e539e888ae8b7bf7710&device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 1098 time: 0.0755100
May 20 16:29:03.417784 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-8ed74e32-4cd7-4f7a-ab29-a070d4e2e12f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:03.419761 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-8ed74e32-4cd7-4f7a-ab29-a070d4e2e12f service neutron] 10.222.0.16 "GET /v2.0/networks?id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 200  len: 912 time: 0.2238376
May 20 16:29:03.523480 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-f785a8f0-e7f2-4917-bc1f-a2df91c2cb62 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8 HTTP/1.1" status: 200  len: 1000 time: 0.0965478
May 20 16:29:03.586663 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-f82e5583-c8ce-450c-bfc0-f0075c114d6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:03.588113 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-f82e5583-c8ce-450c-bfc0-f0075c114d6f service neutron] 10.222.0.16 "GET /v2.0/subnets?id=0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 200  len: 850 time: 0.0581851
May 20 16:29:03.663598 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-01dc30e7-b0c7-4908-a733-9b0f37fa253a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:03.670082 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-01dc30e7-b0c7-4908-a733-9b0f37fa253a service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=27fc1d30-3be1-47fb-bb79-13211cc6a4bc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0699174
May 20 16:29:03.800374 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-fc6695af-49a8-42e5-919e-0418ca6df51c service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1275055
May 20 16:29:03.934019 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-725bc39a-31ae-4936-90d2-73f0dc5102a9 req-efd5f223-83b9-4f04-bc14-688f86c9f0b2 service neutron] 10.222.0.16 "GET /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1268349
May 20 16:29:14.957210 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:29:15.891957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b4bcd138-d4e9-48aa-9258-c1044ec717ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:18.457788 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:18.640900 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9902ddd0-c9db-4c4a-a0a1-a04dcb223239 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:19.652547 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:21.274499 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:29.381310 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:33.876198 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39558) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:33.994015 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:34.008136 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:29:34.011951 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Usage tracker for resource:security_group_rule and tenant:06c7c40f4def4f38b8e036e9528cb451 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:29:34.014754 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:29:34.020968 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:29:34.100183 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:34.192444 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:34.202064 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bf6464ea-8e32-4c72-8f98-6bbb26a59502 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:34.239305 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81920e60-3c95-4cf1-879a-440f14e11040,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:34.243158 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=06c7c40f4def4f38b8e036e9528cb451&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3659577
May 20 16:29:34.245914 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39564) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:34.249242 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.249625 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.249999 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.250391 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.250755 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.251118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.251501 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.251860 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.252216 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.252569 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.252918 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.253265 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:34.257238 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-81dac3da-7ed2-432f-97a8-c69a04a1d373 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:34.308903 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-45620e9b-e6ef-4df9-ba31-79270baf2dea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:34.334706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-45620e9b-e6ef-4df9-ba31-79270baf2dea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:34.469147 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-45620e9b-e6ef-4df9-ba31-79270baf2dea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:34.473729 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1690832e-ee2c-4ef3-a5a2-2839384bc88d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:34.487576 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45620e9b-e6ef-4df9-ba31-79270baf2dea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81920e60-3c95-4cf1-879a-440f14e11040,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:34.490558 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-45620e9b-e6ef-4df9-ba31-79270baf2dea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:34.495051 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-45620e9b-e6ef-4df9-ba31-79270baf2dea admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:34.496434 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-45620e9b-e6ef-4df9-ba31-79270baf2dea admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/81920e60-3c95-4cf1-879a-440f14e11040 HTTP/1.1" status: 204  len: 168 time: 0.2493157
May 20 16:29:41.328981 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9449766-d796-4cf1-bfd8-f0697825b7da req-f5c6dc8c-f834-4abd-b954-775c696700e2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:41.331377 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a9449766-d796-4cf1-bfd8-f0697825b7da req-f5c6dc8c-f834-4abd-b954-775c696700e2 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 945 time: 0.0852950
May 20 16:29:41.380700 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a9449766-d796-4cf1-bfd8-f0697825b7da req-e9c06d10-4144-41a6-baf5-cf7af121af30 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432215
May 20 16:29:42.567385 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d042d0c-2280-4b8a-9c86-70466392cef2 req-e48daabb-5230-436c-9b4b-755de39d399e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:42.568971 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d042d0c-2280-4b8a-9c86-70466392cef2 req-e48daabb-5230-436c-9b4b-755de39d399e tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 945 time: 0.0804951
May 20 16:29:42.615944 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2d042d0c-2280-4b8a-9c86-70466392cef2 req-45815279-1ef3-4392-ad7b-31dfd1703b8c tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401878
May 20 16:29:43.480287 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-6478bd4b-cc5b-4ff1-82dc-9212753d4f8b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:43.481631 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-6478bd4b-cc5b-4ff1-82dc-9212753d4f8b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 945 time: 0.0848351
May 20 16:29:43.622332 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Deleting port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:29:43.623079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:43.814984 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] For port d8d87b5c-b974-45eb-ae3b-f65255d49ca8, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:29:43.815367 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:43.929768 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f17e48-12aa-4c40-8584-7b740988b886 req-2b3361c2-a3eb-4280-9932-83a0cf1a1a30 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:29:43.931239 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-69f17e48-12aa-4c40-8584-7b740988b886 req-2b3361c2-a3eb-4280-9932-83a0cf1a1a30 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 945 time: 0.2056401
May 20 16:29:44.060438 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-69f17e48-12aa-4c40-8584-7b740988b886 req-3c2b41b5-07ee-47c2-96dd-4deb657c4a96 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups?id=8a807f28-b3c1-420c-9abe-bf45e2445898&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0729425
May 20 16:29:44.266740 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:44.267112 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:44.267457 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Floating IP f42662cd-89d6-4119-b5eb-8b16bc818fee disassociated. External IP: 172.27.0.40, port: d8d87b5c-b974-45eb-ae3b-f65255d49ca8.
May 20 16:29:44.267801 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Calling delete_port for d8d87b5c-b974-45eb-ae3b-f65255d49ca8 owned by compute:nova {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:29:44.484822 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:44.491147 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:44.542721 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event deleted for resources: {'Port': ['ID=d8d87b5c-b974-45eb-ae3b-f65255d49ca8,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:44.547359 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:44.749817 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Router 27c15c4b-53de-4418-8ed7-78ad6d465033 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:29:44.950083 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:29:44.960036 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] Sync routers for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:29:44.970241 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:29:44.970963 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712c9e130>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:29:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:45.027895 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] No DVR routers for this DVR port d8d87b5c-b974-45eb-ae3b-f65255d49ca8 on host hv-cinder-68948 {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:29:45.030616 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:45.033813 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'name': 'network-vif-deleted', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:29:45.099357 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91ec44c4-2ea6-485c-9249-9a9ae85c23cd', 'name': 'network-vif-deleted', 'tag': 'd8d87b5c-b974-45eb-ae3b-f65255d49ca8', 'status': 'completed', 'code': 200}
May 20 16:29:45.119061 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-146f3ae6-3f17-4fc2-af01-888c0f8f59e1 req-c5fc5168-f44d-4689-b9c9-7a44c51f2370 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.16 "DELETE /v2.0/ports/d8d87b5c-b974-45eb-ae3b-f65255d49ca8 HTTP/1.1" status: 204  len: 173 time: 1.6309309
May 20 16:29:45.172765 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:29:45.223063 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-85949098-51aa-448b-9caa-4831f2c0823f req-4ff33104-5703-40c7-bfb7-d9e24a8d20f0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Synchronizing usage tracker for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:29:45.309733 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-85949098-51aa-448b-9caa-4831f2c0823f req-4ff33104-5703-40c7-bfb7-d9e24a8d20f0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Unset dirty status for tenant:d01080acc33f4e539e888ae8b7bf7710 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:29:45.322796 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-85949098-51aa-448b-9caa-4831f2c0823f req-4ff33104-5703-40c7-bfb7-d9e24a8d20f0 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/ports?device_id=91ec44c4-2ea6-485c-9249-9a9ae85c23cd HTTP/1.1" status: 200  len: 210 time: 0.1400476
May 20 16:29:45.529968 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712c9e130>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:45.534702 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] Checking router: 27c15c4b-53de-4418-8ed7-78ad6d465033 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:29:45.542499 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:29:45.543090 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712c9e130>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:29:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:45.719355 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:29:45.955241 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7651927c-f21c-4de1-93be-381730bd0960 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:46.041498 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712c9e130>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:46.045304 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48b9cfe-98c0-4d63-a137-344d4c35e114 None None] The sync data for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi is: [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:21:05Z', 'revision_number': 4, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '0c22d087-9163-4497-b56c-9fca902a4033', 'name': '', 'network_id': '27fc1d30-3be1-47fb-bb79-13211cc6a4bc', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'mac_address': 'fa:16:3e:97:7e:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_interface', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:04Z', 'updated_at': '2021-05-20T16:21:14Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'subnets': [{'id': '0920934c-dffc-4a63-a7b4-a241d1aa9eb3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:29:46.264608 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-856868c6-9f83-4e40-9b74-b83d1538b7cd None None] New status for floating IP f42662cd-89d6-4119-b5eb-8b16bc818fee: DOWN {{(pid=92423) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:29:46.519346 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39722) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:46.587650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:46.616555 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:46.729740 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:46.733766 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2cb60082-73e8-440a-a8f7-aea72549ff28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:46.748273 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a807f28-b3c1-420c-9abe-bf45e2445898,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:46.761405 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.761784 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.762160 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.762525 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.762884 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.763284 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.763653 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.764013 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.764425 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.764780 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.765134 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.765504 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:46.768877 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:46.773706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:46.774960 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-e0cf048c-86e3-4378-9389-7827ce26c28b tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "DELETE /v2.0/security-groups/8a807f28-b3c1-420c-9abe-bf45e2445898 HTTP/1.1" status: 204  len: 168 time: 0.2546554
May 20 16:29:46.777521 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39726) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:46.793529 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.api.v2.resource [None req-290f296f-fda3-4e3b-96dc-9e9d776dab0d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] show failed (client error): The resource could not be found.
May 20 16:29:46.794527 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-290f296f-fda3-4e3b-96dc-9e9d776dab0d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "GET /v2.0/security-groups/8a807f28-b3c1-420c-9abe-bf45e2445898 HTTP/1.1" status: 404  len: 347 time: 0.0160909
May 20 16:29:46.797766 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39730) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:47.019779 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Deleting port 426d2c23-d7d6-45cb-a847-37b910ca79a5 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:29:47.020035 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:47.138992 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:47.139377 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:47.267519 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Calling delete_port for 426d2c23-d7d6-45cb-a847-37b910ca79a5 owned by network:floatingip {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:29:47.446523 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:47.450380 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a11ccca2-ee77-4eec-ba01-8866d23c3b3d tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:47.494468 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Pushing event deleted for resources: {'Port': ['ID=426d2c23-d7d6-45cb-a847-37b910ca79a5,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:47.524941 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:47.585066 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks [] for floatingip, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:47.706127 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d8d87b5c-b974-45eb-ae3b-f65255d49ca8 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:29:47.721320 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:47.722702 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-1566cac2-c63e-49f6-9478-f1a9dc88f18d tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] 10.222.0.64 "DELETE /v2.0/floatingips/f42662cd-89d6-4119-b5eb-8b16bc818fee HTTP/1.1" status: 204  len: 168 time: 0.9239724
May 20 16:29:47.747609 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: d8d87b5c-b974-45eb-ae3b-f65255d49ca8 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:29:47.748040 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device d8d87b5c-b974-45eb-ae3b-f65255d49ca8 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:29:48.480507 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:48.683526 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d55781e7-9796-42f7-8c64-9feb948cf1ee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:49.697826 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:51.306661 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:51.955721 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:29:52.197960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39786) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:53.107647 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:53.529224 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Deleting port 0c22d087-9163-4497-b56c-9fca902a4033 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:29:53.529880 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:53.646892 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] For port 0c22d087-9163-4497-b56c-9fca902a4033, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=0c22d087-9163-4497-b56c-9fca902a4033,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:29:53.647600 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:53.774295 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Calling delete_port for 0c22d087-9163-4497-b56c-9fca902a4033 owned by network:router_interface {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:29:54.069595 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:54.073541 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-524ef4f6-0370-452c-bb3e-c69dab094f68 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:54.119741 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Pushing event deleted for resources: {'Port': ['ID=0c22d087-9163-4497-b56c-9fca902a4033,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:54.122658 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:54.394776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:54.883059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Router 27c15c4b-53de-4418-8ed7-78ad6d465033 has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:29:55.061938 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:29:55.070996 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] Sync routers for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:29:55.075455 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-3bef5469-8c02-4957-851c-e1bd8c155a7a admin admin] 10.222.0.64 "PUT /v2.0/routers/27c15c4b-53de-4418-8ed7-78ad6d465033/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8763914
May 20 16:29:55.076705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39796) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:55.080420 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:29:55.081025 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712d8c850>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:29:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:55.257050 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks [] for router, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:55.265222 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:29:55.429547 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:55.564381 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712d8c850>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127'}], 'enable_snat': True}, 'gw_port_id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:29:53Z', 'revision_number': 5, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port': {'id': '61bee453-0d41-4f2d-ba44-53e5f933c0ff', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:d3:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'device_owner': 'network:router_gateway', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:21:01Z', 'updated_at': '2021-05-20T16:21:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:55.568699 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] Checking router: 27c15c4b-53de-4418-8ed7-78ad6d465033 for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:29:55.577227 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] Routers {'27c15c4b-53de-4418-8ed7-78ad6d465033'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:29:55.577877 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712d8c850>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:29:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['27c15c4b-53de-4418-8ed7-78ad6d465033'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:55.621342 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Deleting port 61bee453-0d41-4f2d-ba44-53e5f933c0ff {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:29:55.621689 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:55.744755 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] For port 61bee453-0d41-4f2d-ba44-53e5f933c0ff, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=61bee453-0d41-4f2d-ba44-53e5f933c0ff,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:29:55.745113 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:55.756676 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] Set router 27c15c4b-53de-4418-8ed7-78ad6d465033 gateway port host: None {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:29:55.867999 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712d8c850>, [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:29:55Z', 'revision_number': 6, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port_host': None}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:55.868462 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Calling delete_port for 61bee453-0d41-4f2d-ba44-53e5f933c0ff owned by network:router_gateway {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:29:55.872559 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d57ac34-d6ec-48f4-9aeb-106853172e25 None None] The sync data for ids ['27c15c4b-53de-4418-8ed7-78ad6d465033'] in dv-cinder-689486-13-iscsi is: [{'id': '27c15c4b-53de-4418-8ed7-78ad6d465033', 'name': 'tempest-AttachVolumeTestJSON-1668747514-router', 'tenant_id': 'd01080acc33f4e539e888ae8b7bf7710', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:21:00Z', 'updated_at': '2021-05-20T16:29:55Z', 'revision_number': 6, 'project_id': 'd01080acc33f4e539e888ae8b7bf7710', 'gw_port_host': None}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:29:56.091892 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.096512 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-01a1747c-3579-41fe-bc9d-f29262359312 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:56.256231 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Pushing event deleted for resources: {'Port': ['ID=61bee453-0d41-4f2d-ba44-53e5f933c0ff,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:56.259629 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:56.350920 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.518318 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.520486 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.671960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.672505 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 27c15c4b-53de-4418-8ed7-78ad6d465033 {{(pid=92422) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:29:56.685034 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.686156 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-8e21d062-2fa1-40a0-93f4-2963bb6a1dd6 admin admin] 10.222.0.64 "DELETE /v2.0/routers/27c15c4b-53de-4418-8ed7-78ad6d465033 HTTP/1.1" status: 204  len: 168 time: 1.6085079
May 20 16:29:56.689370 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39804) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:56.748945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_v2 [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Deleting subnet 0920934c-dffc-4a63-a7b4-a241d1aa9eb3 {{(pid=92421) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:29:56.751787 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.807618 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6100281'] for subnet, precommit_delete_associations {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:56.888917 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.240827 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6100763', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6029158'] for subnet, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.245342 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:57.279550 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0920934c-dffc-4a63-a7b4-a241d1aa9eb3,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:57.282398 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:57.283376 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] Notify callbacks [] for subnet, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.289746 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-c92440fa-aae3-42de-857f-933e6730c3ba admin admin] 10.222.0.64 "DELETE /v2.0/subnets/0920934c-dffc-4a63-a7b4-a241d1aa9eb3 HTTP/1.1" status: 204  len: 168 time: 0.5993621
May 20 16:29:57.290669 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf86077e-5596-4ba8-bac8-883dbd21a5f9 None None] Network 27fc1d30-3be1-47fb-bb79-13211cc6a4bc requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:29:57.292248 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39808) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:57.396684 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.473823 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Deleting port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:29:57.474163 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.536803 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] DHCP port deletion for 27fc1d30-3be1-47fb-bb79-13211cc6a4bc request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:29:57.574561 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] For port 548c0205-ec17-4f3a-8eed-d4b388ae8c28, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=548c0205-ec17-4f3a-8eed-d4b388ae8c28,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:29:57.574916 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.602972 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Deleting port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:29:57.603392 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.707249 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] For port 548c0205-ec17-4f3a-8eed-d4b388ae8c28, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=548c0205-ec17-4f3a-8eed-d4b388ae8c28,segment=NetworkSegment(785db113-1101-4c8c-b7d8-797ca01e729a),segment_id=785db113-1101-4c8c-b7d8-797ca01e729a)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:29:57.707647 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.799906 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Calling delete_port for 548c0205-ec17-4f3a-8eed-d4b388ae8c28 owned by network:dhcp {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:29:57.828992 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 0c22d087-9163-4497-b56c-9fca902a4033 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:29:57.862280 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Calling delete_port for 548c0205-ec17-4f3a-8eed-d4b388ae8c28 owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:29:57.870769 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 0c22d087-9163-4497-b56c-9fca902a4033 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:29:57.871114 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 0c22d087-9163-4497-b56c-9fca902a4033 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:29:57.871559 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 548c0205-ec17-4f3a-8eed-d4b388ae8c28 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:29:57.911928 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:57.916750 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:57.945134 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No active binding found for port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 {{(pid=92423) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}}
May 20 16:29:57.945538 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 548c0205-ec17-4f3a-8eed-d4b388ae8c28 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:29:57.945971 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 61bee453-0d41-4f2d-ba44-53e5f933c0ff no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:29:57.961020 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Pushing event deleted for resources: {'Port': ['ID=548c0205-ec17-4f3a-8eed-d4b388ae8c28,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:57.966169 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] No DVR routers for this DVR port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 on host dv-cinder-689486-13-iscsi {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:29:57.967720 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:57.982940 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 61bee453-0d41-4f2d-ba44-53e5f933c0ff {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:29:57.983310 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 61bee453-0d41-4f2d-ba44-53e5f933c0ff not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:29:58.001247 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.005425 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:58.048600 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Pushing event deleted for resources: {'Port': ['ID=548c0205-ec17-4f3a-8eed-d4b388ae8c28,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:58.053542 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] No DVR routers for this DVR port 548c0205-ec17-4f3a-8eed-d4b388ae8c28 on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:29:58.058789 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.059127 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.059494 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.059816 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.060127 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.060444 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.060758 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.061067 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.061380 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.061688 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.061995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.062302 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:29:58.066287 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-6790d2ea-cb17-4867-a3a6-52528bf74d6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:58.081891 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.098666 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe7126c7fd0>,) {'filters': {'network_id': ['27fc1d30-3be1-47fb-bb79-13211cc6a4bc']}} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:58.110624 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7126c7fd0>, '785db113-1101-4c8c-b7d8-797ca01e729a') {'for_net_delete': True} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:58.110918 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.services.segments.db [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7126c7fd0>, '785db113-1101-4c8c-b7d8-797ca01e729a') {} {{(pid=92421) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:29:58.122546 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6100278'] for segment, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.138925 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.144800 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Releasing vlan 645 on physical network physnet1 to pool {{(pid=92421) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:29:58.145175 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6100925'] for segment, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]: Traceback (most recent call last):
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     timer()
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     cb(*args, **kw)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     return func(*args, **kwargs)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     self._notify()
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     self.callback(batched_events)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     event.method(event)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     return f(self, *a, **k)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._get(url).json()
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     return self.request(url, 'GET', **kwargs)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:29:58.157783 dv-cinder-689486-13-iscsi neutron-server[92421]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:29:58.303349 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.306930 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:58.324103 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.334254 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Pushing event deleted for resources: {'Network': ['ID=27fc1d30-3be1-47fb-bb79-13211cc6a4bc,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:58.337371 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:58.421268 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-ccd45c0c-fc21-4b56-b6b4-7c9dd51af4df admin admin] 10.222.0.64 "DELETE /v2.0/networks/27fc1d30-3be1-47fb-bb79-13211cc6a4bc HTTP/1.1" status: 204  len: 168 time: 1.1280570
May 20 16:29:58.793051 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39820) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:58.842384 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-32c690e3-7fa8-4833-b035-983a1ac49907 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=d01080acc33f4e539e888ae8b7bf7710&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0479872
May 20 16:29:58.844606 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39824) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:29:58.902387 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1eb49d05-fb5f-4b41-b043-8fe75b33c1e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:58.927965 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1eb49d05-fb5f-4b41-b043-8fe75b33c1e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:59.095073 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1eb49d05-fb5f-4b41-b043-8fe75b33c1e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:59.100077 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d06cead5-ae40-4f13-9dde-378b86659601 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:29:59.113717 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb49d05-fb5f-4b41-b043-8fe75b33c1e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9aafd63-8547-4b94-abd9-4a26c0716948,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:29:59.118417 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1eb49d05-fb5f-4b41-b043-8fe75b33c1e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:29:59.120386 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1eb49d05-fb5f-4b41-b043-8fe75b33c1e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:29:59.121507 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-1eb49d05-fb5f-4b41-b043-8fe75b33c1e3 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/f9aafd63-8547-4b94-abd9-4a26c0716948 HTTP/1.1" status: 204  len: 168 time: 0.2758682
May 20 16:29:59.366413 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.322434 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39916) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:02.436430 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.453569 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:02.457880 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Usage tracker for resource:security_group_rule and tenant:3464a37648814ac491727684650de13b is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:02.460732 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:02.466382 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:02.547034 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.614312 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.622923 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-3d607cdc-46e8-4a94-a52f-775835b1ab96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:02.663078 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=3464a37648814ac491727684650de13b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3395457
May 20 16:30:02.663913 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8faff9fb-8de6-462a-b61f-b9e1ffaca29a,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:02.665861 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39924) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:02.666989 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-670201cf-be9b-4d1e-95b2-dd30320d65cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:02.723490 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d979d67a-14cb-4099-83e5-855dc1c62df5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.748180 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d979d67a-14cb-4099-83e5-855dc1c62df5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.877970 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d979d67a-14cb-4099-83e5-855dc1c62df5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.881561 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-a4b22473-f126-4254-808b-dd98277e7055 tempest-TestMinimumBasicScenario-148525641 tempest-TestMinimumBasicScenario-148525641-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:02.892538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d979d67a-14cb-4099-83e5-855dc1c62df5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8faff9fb-8de6-462a-b61f-b9e1ffaca29a,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:02.896474 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d979d67a-14cb-4099-83e5-855dc1c62df5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:02.899739 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d979d67a-14cb-4099-83e5-855dc1c62df5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:02.900815 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d979d67a-14cb-4099-83e5-855dc1c62df5 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/8faff9fb-8de6-462a-b61f-b9e1ffaca29a HTTP/1.1" status: 204  len: 168 time: 0.2339609
May 20 16:30:03.465961 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39932) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:03.484232 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:03.498769 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:03.503171 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Usage tracker for resource:security_group_rule and tenant:1470935098ec415cbe6f88d082f4a62d is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:03.505951 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:03.511642 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:03.592390 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:03.675268 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:03.684217 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-918c1d6e-0894-4b15-a978-8fcb03c72385 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:03.720248 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=1470935098ec415cbe6f88d082f4a62d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2528634
May 20 16:30:03.723601 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39938) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:03.728180 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02b200c1-0285-4525-b25a-cb8d0389a83a,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:03.731285 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-8871b800-5e3d-4a76-a587-32f329031515 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:03.782126 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:03.807916 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:03.934615 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:03.938405 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-87a0913a-aec0-4136-b0f5-0fd8d78c032a tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:03.949683 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02b200c1-0285-4525-b25a-cb8d0389a83a,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:03.953095 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:03.957476 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:03.958871 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/02b200c1-0285-4525-b25a-cb8d0389a83a HTTP/1.1" status: 204  len: 168 time: 0.2337651
May 20 16:30:06.058146 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-f5be8c6c-f64b-4aa8-a46c-304051be069e service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0753853
May 20 16:30:06.150871 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-14f2335c-6b67-4e13-9bfd-09f282c0dfa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:06.152418 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-14f2335c-6b67-4e13-9bfd-09f282c0dfa3 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1098 time: 0.0727994
May 20 16:30:06.307016 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-be61b9a3-2b5d-46c3-b0ef-0da79b23f5c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:06.308511 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-be61b9a3-2b5d-46c3-b0ef-0da79b23f5c9 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.1357543
May 20 16:30:06.419630 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-6f180b30-7ec1-42f6-8d5a-b640207b3a3b service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 200  len: 1001 time: 0.1028984
May 20 16:30:06.484137 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-3c2fa010-ef25-48da-be35-fcee71d59817 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:06.485614 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-3c2fa010-ef25-48da-be35-fcee71d59817 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0595622
May 20 16:30:06.565948 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-9ab98bcb-db96-4013-93a6-04d7eb3b8c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:06.567400 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-9ab98bcb-db96-4013-93a6-04d7eb3b8c67 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0753458
May 20 16:30:06.702654 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-242421be-b948-40b5-baa6-8d96d14d85e5 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1283703
May 20 16:30:06.903968 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 39992) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:06.931776 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a62ee202-c990-4a4e-abdc-be01804fc5c5 req-a7c51656-2428-46d7-b9fd-575d1ea81e38 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2223902
May 20 16:30:07.034998 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:07.051439 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:07.055868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Usage tracker for resource:security_group_rule and tenant:3b9334fb123441908bf87fc6c7a2cce0 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:07.058776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:07.064714 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:07.152109 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:07.345956 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:07.353547 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-35f3bf2c-aa40-4e35-b8f2-6575fa6a50db tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:07.393831 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=3b9334fb123441908bf87fc6c7a2cce0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4881809
May 20 16:30:07.394719 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d3b5619-8523-41cc-a2c0-a9f4be0690d0,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:07.396546 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 39998) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:07.398157 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-98b9e110-2404-4541-91aa-e1fbec428f95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:07.453744 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:07.479747 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:07.678793 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:07.682841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-4fe20bf6-ba61-4532-8ccb-894df24743eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:07.700573 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d3b5619-8523-41cc-a2c0-a9f4be0690d0,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:07.703460 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:07.713321 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:07.715496 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/7d3b5619-8523-41cc-a2c0-a9f4be0690d0 HTTP/1.1" status: 204  len: 168 time: 0.3170602
May 20 16:30:08.342051 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40010) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:08.360228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:08.374681 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:08.379359 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Usage tracker for resource:security_group_rule and tenant:682d5dc597e6469dadd28071d461e8e4 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:08.382185 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:08.388754 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:08.470412 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:08.571812 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:08.580920 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1909a29b-d275-4831-816c-0fc032aa2aab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:08.619855 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=682d5dc597e6469dadd28071d461e8e4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2767494
May 20 16:30:08.620806 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb4728f7-13bc-4bcc-9ce9-c32d023bf325,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:08.622568 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40014) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:08.623890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-40803a91-a5b5-45ba-bde2-09b16150ac52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:08.686937 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d36b6b91-db57-4dca-9088-df9853aeb857 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:08.711832 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d36b6b91-db57-4dca-9088-df9853aeb857 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:08.840276 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d36b6b91-db57-4dca-9088-df9853aeb857 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:08.845269 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6254eb54-2f52-4306-b3ef-ff6b1c931d04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:08.858187 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36b6b91-db57-4dca-9088-df9853aeb857 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb4728f7-13bc-4bcc-9ce9-c32d023bf325,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:08.860485 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d36b6b91-db57-4dca-9088-df9853aeb857 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:08.869071 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-d36b6b91-db57-4dca-9088-df9853aeb857 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:08.870195 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-d36b6b91-db57-4dca-9088-df9853aeb857 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/bb4728f7-13bc-4bcc-9ce9-c32d023bf325 HTTP/1.1" status: 204  len: 168 time: 0.2460237
May 20 16:30:15.914582 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-96987e93-fe9b-486e-b93d-a88e51f211fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:18.446008 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:18.645982 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-bfd1b691-bcee-4c84-bf5b-6d16aa5aa5de None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:19.682868 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:21.323078 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:28.954376 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:30:29.396177 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:30.611746 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-d793db52-9a30-4f31-912f-5a8722f85cc4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-193855468&fields=id&tenant_id=a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 267 time: 0.0484536
May 20 16:30:30.793096 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-508301aa-2012-4494-9381-9cbf8b4481fc tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:30.800153 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-508301aa-2012-4494-9381-9cbf8b4481fc tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 812 time: 0.1816471
May 20 16:30:30.816297 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-99fd3487-209f-41b7-92f9-ae2694953504 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/quotas/a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 375 time: 0.0149004
May 20 16:30:30.914383 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-7f7d0f32-8404-4afb-929a-593cdfa69e54 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0960121
May 20 16:30:31.180151 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-2f49997e-e1d1-4df1-840e-925ec89f39f9 service neutron] 10.222.0.64 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2541859
May 20 16:30:31.322558 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-9b0a9faa-9726-43f9-b462-c4d5c5ba7cdc service neutron] 10.222.0.64 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1365800
May 20 16:30:32.046718 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f54da3fc-541d-4fd9-a5e9-5db4eee96b60 req-ed69d434-5a82-4160-add1-99b41082c2e9 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 210 time: 0.0526261
May 20 16:30:33.204376 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-023e2f4f-3f4b-438a-8b17-1b1c8db76f4e req-0e035177-55fa-4ed1-8e95-a4570262ba69 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 210 time: 0.0507236
May 20 16:30:34.219752 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-a4391099-32d9-45b1-b065-a3e2f5020768 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:34.221204 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-a4391099-32d9-45b1-b065-a3e2f5020768 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 812 time: 0.1547887
May 20 16:30:34.276045 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-65e630a1-da4e-49cf-8725-73a99c8bb255 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a6bd88ff65e9420a8ccb36968532c4f6 HTTP/1.1" status: 200  len: 379 time: 0.0451281
May 20 16:30:34.284901 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'port': {'device_id': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'admin_state_up': True, 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'security_groups': ['da77fa6e-aadb-4acb-8e30-527bbdccd591']}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:30:34.434200 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d8cc2003-d385-451c-9a6e-ff30d2402ad0 req-2f724935-b3ad-4dfc-943a-89a699dfaa07 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 210 time: 0.0561039
May 20 16:30:34.480270 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:34.491548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:34.588217 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Made reservation on behalf of a6bd88ff65e9420a8ccb36968532c4f6 for: {'port': 1} {{(pid=92421) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 16:30:34.589115 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:34.702834 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40280) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:34.805377 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Allocated IP 172.20.0.7 (a02876f9-a796-4512-9044-eb08bb5d54c6/cb578eb9-d6e8-4e33-8d08-43894fe771d7/561766a2-b146-4675-8333-f168ef61695c) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:30:34.838379 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:34.854707 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:34.859014 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Usage tracker for resource:security_group_rule and tenant:4f184172c3f7468d85e7fbbacdc42a1d is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:34.865218 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:34.868739 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:34.959308 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.019097 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.024932 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.034700 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-51902ae5-b29d-4ecb-91d0-7d983a8dc774 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:35.049269 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Transition to ACTIVE for port object 561766a2-b146-4675-8333-f168ef61695c will not be triggered until provisioned by entity DHCP. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:30:35.075042 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d687f99-6f09-431a-96fc-a9de61f2c718,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:35.082891 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40290) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:35.083260 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=4f184172c3f7468d85e7fbbacdc42a1d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3783307
May 20 16:30:35.083260 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4ae75c55-9be4-41ed-95cb-3519ea68ab63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:35.230635 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.240607 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-10a02d8c-905d-4627-8e0b-913549310a7d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:35.331853 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1bfc1bc9-20db-4d0b-a670-00668a50e606 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.335844 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Network a02876f9-a796-4512-9044-eb08bb5d54c6 is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:30:35.338969 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=561766a2-b146-4675-8333-f168ef61695c,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:35.341157 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:30:35.343752 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:30:35.395625 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.395997 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.396360 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.396718 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.397067 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.397420 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.397768 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.398113 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.398459 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.398836 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.399263 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.404768 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:30:35.404768 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:35.434411 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1bfc1bc9-20db-4d0b-a670-00668a50e606 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.463049 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:35.463049 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.641571 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-77c0ca79-2fcd-41b8-86e4-5d9061031298 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3606915
May 20 16:30:35.656568 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Request body: {'port': {'device_id': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-68948'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:30:35.700066 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1bfc1bc9-20db-4d0b-a670-00668a50e606 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.712218 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-77c2112d-bf92-4966-8f4b-2bf607a21de7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:35.740925 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bfc1bc9-20db-4d0b-a670-00668a50e606 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d687f99-6f09-431a-96fc-a9de61f2c718,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:35.743224 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-1bfc1bc9-20db-4d0b-a670-00668a50e606 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:35.762730 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-92b486c3-84c1-4467-9711-65a31fd1a5b8 None None] Provisioning for port 561766a2-b146-4675-8333-f168ef61695c completed by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:30:35.772345 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-92b486c3-84c1-4467-9711-65a31fd1a5b8 None None] Provisioning complete for port 561766a2-b146-4675-8333-f168ef61695c triggered by entity DHCP. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:30:35.773313 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-92b486c3-84c1-4467-9711-65a31fd1a5b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.783350 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-1bfc1bc9-20db-4d0b-a670-00668a50e606 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.789345 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-1bfc1bc9-20db-4d0b-a670-00668a50e606 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/0d687f99-6f09-431a-96fc-a9de61f2c718 HTTP/1.1" status: 204  len: 168 time: 0.7012033
May 20 16:30:35.831240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-535f5c77-31d6-4be9-9062-0f41e978624a req-92a56086-f81b-4ac8-918a-8f332427a800 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:35.831951 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-535f5c77-31d6-4be9-9062-0f41e978624a req-92a56086-f81b-4ac8-918a-8f332427a800 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:30:35.837144 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-92b486c3-84c1-4467-9711-65a31fd1a5b8 None None] Port 561766a2-b146-4675-8333-f168ef61695c cannot update to ACTIVE because it is not bound. {{(pid=92423) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 16:30:35.839664 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:35.970772 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-535f5c77-31d6-4be9-9062-0f41e978624a req-92a56086-f81b-4ac8-918a-8f332427a800 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:30:35.974903 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-535f5c77-31d6-4be9-9062-0f41e978624a req-92a56086-f81b-4ac8-918a-8f332427a800 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 931 time: 0.3671236
May 20 16:30:36.063779 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-535f5c77-31d6-4be9-9062-0f41e978624a req-0183570f-2f4b-4fca-b1a1-d37f11844fa4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0807524
May 20 16:30:36.233436 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 561766a2-b146-4675-8333-f168ef61695c {{(pid=92421) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:30:36.241507 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.256155 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.provisioning_blocks [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Transition to ACTIVE for port object 561766a2-b146-4675-8333-f168ef61695c will not be triggered until provisioned by entity L2. {{(pid=92421) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 16:30:36.337448 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.342311 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c201ed1f-e331-46c3-bea1-ff606cea1f83 tempest-AttachVolumeTestJSON-1878104448 tempest-AttachVolumeTestJSON-1878104448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:36.502463 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Pushing event updated for resources: {'Port': ['ID=561766a2-b146-4675-8333-f168ef61695c,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:36.505517 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:36.573007 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40306) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:36.595091 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.623531 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:36.628319 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Attempting to bind port 561766a2-b146-4675-8333-f168ef61695c on host hv-cinder-68948 for vnic_type normal with profile  {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 16:30:36.628659 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Attempting to bind port 561766a2-b146-4675-8333-f168ef61695c by drivers openvswitch,hyperv on host hv-cinder-68948 at level 0 using segments [{'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 16:30:36.629020 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Attempting to bind port 561766a2-b146-4675-8333-f168ef61695c on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:30:36.632564 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Usage tracker for resource:security_group_rule and tenant:61d5445ba5bd41c1957aa613e7c640a4 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:36.636842 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:36.639551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Port 561766a2-b146-4675-8333-f168ef61695c on network a02876f9-a796-4512-9044-eb08bb5d54c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-68948 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 16:30:36.639879 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Attempting to bind port 561766a2-b146-4675-8333-f168ef61695c on network a02876f9-a796-4512-9044-eb08bb5d54c6 {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 16:30:36.645676 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:36.650225 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Checking agent: {'id': '0deb6e96-59b2-4f1b-b6d0-5126541da984', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-68948', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'started_at': datetime.datetime(2021, 5, 20, 16, 14, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 16, 30, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 16:30:36.650564 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Checking segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92421) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 16:30:36.650945 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Bound using segment: {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'} {{(pid=92421) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 16:30:36.651404 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.managers [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Bound port: 561766a2-b146-4675-8333-f168ef61695c, host: hv-cinder-68948, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6'}}] {{(pid=92421) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 16:30:36.651751 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.774725 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] For port 561766a2-b146-4675-8333-f168ef61695c, host hv-cinder-68948, cleared binding levels {{(pid=92421) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 16:30:36.780555 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] For port 561766a2-b146-4675-8333-f168ef61695c, host hv-cinder-68948, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=561766a2-b146-4675-8333-f168ef61695c,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92421) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 16:30:36.797259 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40312) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:36.821236 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.842692 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.847434 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c346556d-16b2-4b27-b222-63d3b0fdd910 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:36.903802 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.913419 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:36.914039 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.915429 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] 10.222.0.16 "PUT /v2.0/ports/561766a2-b146-4675-8333-f168ef61695c HTTP/1.1" status: 200  len: 1093 time: 1.2654440
May 20 16:30:36.916131 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'tag': '561766a2-b146-4675-8333-f168ef61695c'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:30:36.919235 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:36.934651 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:36.938378 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Usage tracker for resource:security_group_rule and tenant:9bb8f1843b0d44ad9b9c87b038983c42 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:36.941538 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:36.949804 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:36.962376 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=61d5445ba5bd41c1957aa613e7c640a4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3923998
May 20 16:30:36.963622 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Pushing event updated for resources: {'Port': ['ID=561766a2-b146-4675-8333-f168ef61695c,revision_number=3']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:36.967061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5306f97b-c09d-4f9a-9eb1-d1aadf1ec4bd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:36.967694 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40320) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:36.968371 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e45f31e2-4a4c-4714-ad60-8dedb73d0e8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.052s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:36.990072 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'tag': '561766a2-b146-4675-8333-f168ef61695c', 'status': 'completed', 'code': 200}
May 20 16:30:37.056447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.066679 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ad1732e-5a47-4a4a-aa92-fcb8f55a5dbd,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:37.081240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-88426e9d-f030-4ebc-a14f-ca1fc5bcaac4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:37.118714 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-344bb4b3-d842-492b-aeba-6f42cba84452 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.128117 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.138120 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4189969e-c2c6-45a3-9f12-78b109bfe063 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:37.150691 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-344bb4b3-d842-492b-aeba-6f42cba84452 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.164810 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df0d432-7ac0-4e8f-941d-ffd39165501e req-6f541284-e56b-47df-aac2-f30e41fe36b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:37.166473 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2df0d432-7ac0-4e8f-941d-ffd39165501e req-6f541284-e56b-47df-aac2-f30e41fe36b6 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 1096 time: 0.1584044
May 20 16:30:37.182260 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=9bb8f1843b0d44ad9b9c87b038983c42&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3838334
May 20 16:30:37.184073 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3212cc16-00d1-49a1-9766-c458dfe82430,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:37.191177 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:37.192842 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40326) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:37.251650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8ab4b1f9-87f6-440c-b61b-0853a056c734 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.277731 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8ab4b1f9-87f6-440c-b61b-0853a056c734 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.402616 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8ab4b1f9-87f6-440c-b61b-0853a056c734 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.406269 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-bf259682-880a-42f1-9c58-5122581794b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:37.418305 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab4b1f9-87f6-440c-b61b-0853a056c734 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3212cc16-00d1-49a1-9766-c458dfe82430,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:37.425490 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-8ab4b1f9-87f6-440c-b61b-0853a056c734 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:37.435291 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-8ab4b1f9-87f6-440c-b61b-0853a056c734 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.439090 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-8ab4b1f9-87f6-440c-b61b-0853a056c734 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/3212cc16-00d1-49a1-9766-c458dfe82430 HTTP/1.1" status: 204  len: 168 time: 0.2424455
May 20 16:30:37.478898 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df0d432-7ac0-4e8f-941d-ffd39165501e req-076175cc-f2bd-46ec-8fb5-a48f8fb6bd77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:37.480391 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2df0d432-7ac0-4e8f-941d-ffd39165501e req-076175cc-f2bd-46ec-8fb5-a48f8fb6bd77 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&shared=False HTTP/1.1" status: 200  len: 913 time: 0.3072596
May 20 16:30:37.488777 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a865351d-d534-4094-8025-e894a88bf52a req-76a26a0b-eff1-4ed5-aa8e-21d901b9f11a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:37.490131 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a865351d-d534-4094-8025-e894a88bf52a req-76a26a0b-eff1-4ed5-aa8e-21d901b9f11a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.3131373
May 20 16:30:37.546704 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-344bb4b3-d842-492b-aeba-6f42cba84452 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.555526 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-66d84fea-c49d-4e41-9140-473cd9db3dd1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:37.625605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344bb4b3-d842-492b-aeba-6f42cba84452 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ad1732e-5a47-4a4a-aa92-fcb8f55a5dbd,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:37.635807 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-344bb4b3-d842-492b-aeba-6f42cba84452 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:37.648889 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-a865351d-d534-4094-8025-e894a88bf52a req-e2682a60-9da1-49a6-bb7f-2cd2aa2da539 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1393678
May 20 16:30:37.649674 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-344bb4b3-d842-492b-aeba-6f42cba84452 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:37.650662 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-344bb4b3-d842-492b-aeba-6f42cba84452 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/5ad1732e-5a47-4a4a-aa92-fcb8f55a5dbd HTTP/1.1" status: 204  len: 168 time: 0.6653688
May 20 16:30:37.687633 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df0d432-7ac0-4e8f-941d-ffd39165501e req-05b23323-2d8b-4071-bea8-1fbb86f6d198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:37.696166 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-2df0d432-7ac0-4e8f-941d-ffd39165501e req-05b23323-2d8b-4071-bea8-1fbb86f6d198 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1982589
May 20 16:30:37.820548 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-fec1a5ee-e437-4ad9-b548-2d6fd6ca7816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:37.822124 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-fec1a5ee-e437-4ad9-b548-2d6fd6ca7816 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 1096 time: 0.0928750
May 20 16:30:37.891326 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-c0490ced-1a99-4f2b-b3ea-5e0b581e5e10 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=561766a2-b146-4675-8333-f168ef61695c HTTP/1.1" status: 200  len: 217 time: 0.0625637
May 20 16:30:37.956018 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-70b49fdc-ae38-4137-a7fc-6fa8b74bf770 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:37.957493 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-70b49fdc-ae38-4137-a7fc-6fa8b74bf770 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0609272
May 20 16:30:38.053480 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-2ac04c40-e12d-4b78-92f0-ae08246d3505 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:38.055265 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-2ac04c40-e12d-4b78-92f0-ae08246d3505 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0913393
May 20 16:30:38.201939 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-b0c4696d-4fdb-49f9-a36d-b437c2f765ee service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1376364
May 20 16:30:38.358461 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efb3a65e-61e6-4ad5-92a9-0448582ff4b9 req-e0167f25-20ae-4d59-a3d0-57763089d326 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1505203
May 20 16:30:38.853812 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3a6172-deef-442d-a673-6142fc103f85 req-df9bea1b-cb94-45c1-a4e7-1778b932f57f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:38.855415 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f3a6172-deef-442d-a673-6142fc103f85 req-df9bea1b-cb94-45c1-a4e7-1778b932f57f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.0872128
May 20 16:30:38.900481 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9f3a6172-deef-442d-a673-6142fc103f85 req-cd3be046-fdca-4e43-84a0-4398dce9f7c6 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393965
May 20 16:30:40.085202 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe819ee-3dad-4b3c-952d-1003125260c8 req-fe9496ea-4b75-4a08-9bbe-115ffaa19990 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:40.086604 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efe819ee-3dad-4b3c-952d-1003125260c8 req-fe9496ea-4b75-4a08-9bbe-115ffaa19990 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.0832283
May 20 16:30:40.136329 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-efe819ee-3dad-4b3c-952d-1003125260c8 req-8143a2f4-f30a-4970-a793-9a63f5a654f5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434537
May 20 16:30:41.324234 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fdb325e-d6e0-4b2f-9831-9bb7524909f4 req-69241a44-a092-4d75-83a5-79ea4e5165ba tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:41.325701 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5fdb325e-d6e0-4b2f-9831-9bb7524909f4 req-69241a44-a092-4d75-83a5-79ea4e5165ba tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.0808976
May 20 16:30:41.371098 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-5fdb325e-d6e0-4b2f-9831-9bb7524909f4 req-e48d570e-c4f8-494b-a3de-d2a39eab6652 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395093
May 20 16:30:42.563805 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beecd27e-3a12-4ab9-88e7-1e05bc0d0987 req-e38d9b61-ec5d-4097-bcf9-a896e03d464f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:42.564727 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-beecd27e-3a12-4ab9-88e7-1e05bc0d0987 req-e38d9b61-ec5d-4097-bcf9-a896e03d464f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.0829651
May 20 16:30:42.610277 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-beecd27e-3a12-4ab9-88e7-1e05bc0d0987 req-171f7bda-8033-4649-8fc5-03c4158a313b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387614
May 20 16:30:42.658949 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40424) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:42.773907 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:42.787894 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:30:42.791679 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Usage tracker for resource:security_group_rule and tenant:9939e264361244d3b12c0ef75d517674 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:30:42.794487 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:30:42.800438 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:30:42.880939 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:43.001838 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:43.010059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2874b728-5f04-41fb-bf5b-d551ebe666f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:43.048972 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=9939e264361244d3b12c0ef75d517674&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3889647
May 20 16:30:43.049674 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a72debc-a25b-4529-9c35-8e9b10229c7a,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:43.053160 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40430) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:30:43.053465 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2bd52f02-d052-416b-9ec6-ba1fd1c546ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:43.111837 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-67d6a39b-d988-430d-9d6b-8cefaf669a72 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:43.137372 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-67d6a39b-d988-430d-9d6b-8cefaf669a72 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:43.259161 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-67d6a39b-d988-430d-9d6b-8cefaf669a72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:43.263008 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-dced72bd-1560-4a4d-9515-6e5b18614196 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:43.273987 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67d6a39b-d988-430d-9d6b-8cefaf669a72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a72debc-a25b-4529-9c35-8e9b10229c7a,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:43.276599 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-67d6a39b-d988-430d-9d6b-8cefaf669a72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:43.282256 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-67d6a39b-d988-430d-9d6b-8cefaf669a72 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:43.283414 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-67d6a39b-d988-430d-9d6b-8cefaf669a72 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/5a72debc-a25b-4529-9c35-8e9b10229c7a HTTP/1.1" status: 204  len: 168 time: 0.2292366
May 20 16:30:43.807889 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9c46878-d74d-4432-972b-ca8e9b4162fc req-e3f9adfb-099f-4fc0-99ab-9f8b30e7b605 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:43.809275 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f9c46878-d74d-4432-972b-ca8e9b4162fc req-e3f9adfb-099f-4fc0-99ab-9f8b30e7b605 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.0847783
May 20 16:30:43.854845 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f9c46878-d74d-4432-972b-ca8e9b4162fc req-8d62ba26-3e85-4153-b787-7b795636a7a2 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394943
May 20 16:30:45.048984 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91ae3737-23f7-4faf-a0e9-f93f5064488c req-b84fd85c-5095-4cb4-89a3-82eedb1bdee8 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:45.051721 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-91ae3737-23f7-4faf-a0e9-f93f5064488c req-b84fd85c-5095-4cb4-89a3-82eedb1bdee8 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.0868938
May 20 16:30:45.099712 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-91ae3737-23f7-4faf-a0e9-f93f5064488c req-4ae30cb7-ed13-4ab9-a467-7af37efc4093 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395715
May 20 16:30:45.950280 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-a9fe32f5-2383-4fc4-a7c5-28a6a99197ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:46.287036 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda0ec9d-82d0-4a04-9dd1-aa23a1fcceb7 req-69d7f2e8-d785-49d8-b078-9207819900d8 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:46.288536 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dda0ec9d-82d0-4a04-9dd1-aa23a1fcceb7 req-69d7f2e8-d785-49d8-b078-9207819900d8 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.0811024
May 20 16:30:46.334641 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dda0ec9d-82d0-4a04-9dd1-aa23a1fcceb7 req-a89ca843-c5a8-4ec0-913d-f9bdaacf6651 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400491
May 20 16:30:47.616079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f12525e-b22e-498a-b886-ba1ad5fef86b req-a427a392-821e-4dfa-8e22-b5bb8fb6b9be tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:47.617576 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7f12525e-b22e-498a-b886-ba1ad5fef86b req-a427a392-821e-4dfa-8e22-b5bb8fb6b9be tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 943 time: 0.1793017
May 20 16:30:47.664447 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7f12525e-b22e-498a-b886-ba1ad5fef86b req-1b311fd1-2bde-49e6-a030-8adad5bf6016 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411277
May 20 16:30:48.031871 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 561766a2-b146-4675-8333-f168ef61695c details requested by agent hyperv_hv-cinder-68948 with host hv-cinder-68948 {{(pid=92423) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 16:30:48.167686 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 561766a2-b146-4675-8333-f168ef61695c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=561766a2-b146-4675-8333-f168ef61695c,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:30:48.182975 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Returning: {'device': '561766a2-b146-4675-8333-f168ef61695c', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'port_id': '561766a2-b146-4675-8333-f168ef61695c', 'mac_address': 'fa:16:3e:19:03:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 637, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92423) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 16:30:48.242692 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:48.260174 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 561766a2-b146-4675-8333-f168ef61695c {{(pid=92423) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 16:30:48.277103 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 561766a2-b146-4675-8333-f168ef61695c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=561766a2-b146-4675-8333-f168ef61695c,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:30:48.350402 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:48.352212 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:48.426452 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=561766a2-b146-4675-8333-f168ef61695c,revision_number=4']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:48.429667 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:48.487679 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:48.651396 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7345b81d-b72b-494e-b0b0-f5f61b21fdfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:48.846681 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df85e47d-9ef6-4818-a971-864a100dc583 req-a12ca6bf-d10d-4445-bcf3-0308e1f5595c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:48.848212 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-df85e47d-9ef6-4818-a971-864a100dc583 req-a12ca6bf-d10d-4445-bcf3-0308e1f5595c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 944 time: 0.0794926
May 20 16:30:48.895647 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-df85e47d-9ef6-4818-a971-864a100dc583 req-c091b7fd-88f3-4568-b148-8bd8f36c349d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408084
May 20 16:30:49.639925 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:50.077240 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae1840b-aca5-4de1-a55e-42afdf08dff5 req-387a1e26-d1ed-4136-a88a-ca4b9fa765be tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:50.078671 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cae1840b-aca5-4de1-a55e-42afdf08dff5 req-387a1e26-d1ed-4136-a88a-ca4b9fa765be tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 944 time: 0.0778387
May 20 16:30:50.122343 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cae1840b-aca5-4de1-a55e-42afdf08dff5 req-59d88bb5-bfc0-432d-93cc-8058dd9a8a8b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0375381
May 20 16:30:51.313016 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8241ff1d-db95-4f5f-972f-d1c06522c31e req-4e32057d-9c14-45ec-ae59-a941cf791ac6 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:51.314503 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8241ff1d-db95-4f5f-972f-d1c06522c31e req-4e32057d-9c14-45ec-ae59-a941cf791ac6 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 944 time: 0.0845222
May 20 16:30:51.327609 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:51.358716 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8241ff1d-db95-4f5f-972f-d1c06522c31e req-ad43bf19-5ff5-4ebd-bd67-3e229b778377 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386083
May 20 16:30:52.540079 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b89a437-88f6-4e6f-ac03-bc7c617ec44f req-30dcf0a9-040c-4df6-bd19-32c7d08e0bc3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:52.541566 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b89a437-88f6-4e6f-ac03-bc7c617ec44f req-30dcf0a9-040c-4df6-bd19-32c7d08e0bc3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 944 time: 0.0795887
May 20 16:30:52.585818 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8b89a437-88f6-4e6f-ac03-bc7c617ec44f req-d9aacb92-b6fb-465b-a023-de6b8974e770 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0384746
May 20 16:30:52.773466 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] get_ports_and_sgs() called for port_ids ['561766a2-b146-4675-8333-f168ef61695c'] {{(pid=92423) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 16:30:53.775908 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae5cf69-b3b2-4987-a091-f6f9e0ae0510 req-1895a20e-5586-4e17-b068-65bd5a9dc116 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:53.777415 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bae5cf69-b3b2-4987-a091-f6f9e0ae0510 req-1895a20e-5586-4e17-b068-65bd5a9dc116 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 944 time: 0.0839405
May 20 16:30:53.822568 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-bae5cf69-b3b2-4987-a091-f6f9e0ae0510 req-95d6761c-bf8f-4b05-954b-f9a0121517f1 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393047
May 20 16:30:54.777906 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 561766a2-b146-4675-8333-f168ef61695c up at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 16:30:54.967716 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning for port 561766a2-b146-4675-8333-f168ef61695c completed by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 16:30:54.972676 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.provisioning_blocks [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Provisioning complete for port 561766a2-b146-4675-8333-f168ef61695c triggered by entity L2. {{(pid=92423) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 16:30:54.975098 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-854949'] for port, provisioning_complete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:55.018308 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf14217-8af3-41c3-b4ff-6d3611b6b231 req-9ca9393c-0335-45f4-9c8d-fbfb8331f3d5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:55.019820 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edf14217-8af3-41c3-b4ff-6d3611b6b231 req-9ca9393c-0335-45f4-9c8d-fbfb8331f3d5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 944 time: 0.0852900
May 20 16:30:55.066585 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-edf14217-8af3-41c3-b4ff-6d3611b6b231 req-3228b8be-e946-4464-8e7d-43237e117c51 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393605
May 20 16:30:55.091774 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:55.117984 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '561766a2-b146-4675-8333-f168ef61695c'}] {{(pid=92423) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:30:55.127336 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] For port 561766a2-b146-4675-8333-f168ef61695c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=561766a2-b146-4675-8333-f168ef61695c,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:30:55.202131 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037'] for port, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:55.204252 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:30:55.274568 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Pushing event updated for resources: {'Port': ['ID=561766a2-b146-4675-8333-f168ef61695c,revision_number=5']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:30:55.277856 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:30:55.362841 dv-cinder-689486-13-iscsi neutron-server[92423]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '561766a2-b146-4675-8333-f168ef61695c', 'code': 200}
May 20 16:30:55.753915 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a043dd-d80c-41ae-8662-6b301e3b5811 req-56215dc0-b452-46d9-8514-ea73734ceda0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:55.756285 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d0a043dd-d80c-41ae-8662-6b301e3b5811 req-56215dc0-b452-46d9-8514-ea73734ceda0 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 1098 time: 0.0696094
May 20 16:30:56.253324 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bfbc4c0-cd38-46e5-b47b-de766533a9b0 req-7f4c4515-44e0-49b4-9ced-8dd67c691f48 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:56.254785 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9bfbc4c0-cd38-46e5-b47b-de766533a9b0 req-7f4c4515-44e0-49b4-9ced-8dd67c691f48 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0815997
May 20 16:30:56.299065 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-9bfbc4c0-cd38-46e5-b47b-de766533a9b0 req-176acc3d-feeb-4a70-b7c6-353b41562982 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385439
May 20 16:30:57.250577 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d0a043dd-d80c-41ae-8662-6b301e3b5811 req-0c219e07-0df2-460b-9606-4250c2c93eeb service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0357437
May 20 16:30:57.481586 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6455830d-3dbf-4ce8-9468-3fa11148148a req-6073f5f8-2d87-4ae7-aedf-429f188b3c73 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:57.483032 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6455830d-3dbf-4ce8-9468-3fa11148148a req-6073f5f8-2d87-4ae7-aedf-429f188b3c73 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0799053
May 20 16:30:57.526135 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-6455830d-3dbf-4ce8-9468-3fa11148148a req-ca9965b9-d005-423a-985c-68ac9f025656 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373046
May 20 16:30:58.709411 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17aabf3-8d7b-49d6-a21a-74d079b975ce req-f2f46051-8849-4fe4-abf4-67a1f25007b3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:58.710863 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d17aabf3-8d7b-49d6-a21a-74d079b975ce req-f2f46051-8849-4fe4-abf4-67a1f25007b3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0821540
May 20 16:30:58.756194 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-d17aabf3-8d7b-49d6-a21a-74d079b975ce req-f8f1ed5d-56e1-4d55-8de3-c8e3a72907fc tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396278
May 20 16:30:59.395345 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:30:59.943890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-395b2958-b428-452e-9c16-496d5132b4b5 req-026899b4-f852-417c-911d-aca73f279f03 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:30:59.945909 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-395b2958-b428-452e-9c16-496d5132b4b5 req-026899b4-f852-417c-911d-aca73f279f03 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0840888
May 20 16:30:59.989370 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-395b2958-b428-452e-9c16-496d5132b4b5 req-ad9700ee-9871-446d-a45b-e88059d621fd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377147
May 20 16:31:01.173968 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59cbda1b-108e-4434-a97e-2ecf84a4f250 req-73c77cfa-fa81-47ab-b7f2-4c5a324457c4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:01.175844 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-59cbda1b-108e-4434-a97e-2ecf84a4f250 req-73c77cfa-fa81-47ab-b7f2-4c5a324457c4 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0811274
May 20 16:31:01.220070 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-59cbda1b-108e-4434-a97e-2ecf84a4f250 req-c91ea166-7218-4425-81a3-16a7c7689bbf tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383551
May 20 16:31:02.405634 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cda9d5-ca18-42f0-a693-7dbf26955aa3 req-c3639930-6dcd-46a9-8753-ce4f5a0e4d07 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:02.407084 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-01cda9d5-ca18-42f0-a693-7dbf26955aa3 req-c3639930-6dcd-46a9-8753-ce4f5a0e4d07 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0829444
May 20 16:31:02.451746 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-01cda9d5-ca18-42f0-a693-7dbf26955aa3 req-17f0c254-d59f-403a-a5ed-959ba3a2142b tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390673
May 20 16:31:03.635917 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa24566-ea21-445c-8240-af0cebf790d7 req-906d794a-20e7-4546-b8a3-a49a3d50eae5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:03.637475 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cfa24566-ea21-445c-8240-af0cebf790d7 req-906d794a-20e7-4546-b8a3-a49a3d50eae5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0797715
May 20 16:31:03.686836 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-cfa24566-ea21-445c-8240-af0cebf790d7 req-33f3f9d7-78fa-49da-b211-ae6e69bd6c12 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435154
May 20 16:31:04.867416 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa85792f-311a-4c6f-b3b2-7dc0f182c5de req-cdfd7f20-3fab-4e92-b62b-08c1925bf27c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:04.868851 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aa85792f-311a-4c6f-b3b2-7dc0f182c5de req-cdfd7f20-3fab-4e92-b62b-08c1925bf27c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0789816
May 20 16:31:04.911545 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-aa85792f-311a-4c6f-b3b2-7dc0f182c5de req-f0cda118-9405-49c8-a429-0add1720230d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0371120
May 20 16:31:05.176192 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-2d2b7ab1-566d-47b2-9018-e8e5fe01cabb service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0735259
May 20 16:31:05.336519 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-afc79507-4128-449c-9be2-f85188254f1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:05.337997 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-afc79507-4128-449c-9be2-f85188254f1e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1098 time: 0.0782809
May 20 16:31:05.563799 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-3870c4e9-acb5-4f9e-b72b-d55a90fced1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:05.565256 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-3870c4e9-acb5-4f9e-b72b-d55a90fced1f service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.2080030
May 20 16:31:05.669801 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-d4e02ce0-32f0-4b2c-9ae6-0cd8a1260573 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 200  len: 1001 time: 0.0969341
May 20 16:31:05.733550 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-77aac038-4ca0-423b-9e09-7ab321caf5a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:05.735022 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-77aac038-4ca0-423b-9e09-7ab321caf5a7 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0586965
May 20 16:31:05.811829 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-56dad847-0287-44ed-8347-5a2c89caa1e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:05.813280 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-56dad847-0287-44ed-8347-5a2c89caa1e7 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0722780
May 20 16:31:05.942628 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-bdf7bd06-ecd0-47fe-92a1-3eb2eea6c98a service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1215472
May 20 16:31:05.953000 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:31:06.126602 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-98074c35-dbbc-4ada-ba34-5d2844e4ebe0 req-7097b5e9-6358-49e0-957f-77ee6f7daa08 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1765525
May 20 16:31:06.145850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26623827-8b7f-47e2-9c2e-50854f0e3658 req-1f953370-1e5b-4858-9e5f-43532d63d94d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:06.147297 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-26623827-8b7f-47e2-9c2e-50854f0e3658 req-1f953370-1e5b-4858-9e5f-43532d63d94d tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.1176896
May 20 16:31:06.193740 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-26623827-8b7f-47e2-9c2e-50854f0e3658 req-d0581bb5-93e2-47e9-a7ae-3855f1a1dd98 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407879
May 20 16:31:06.377177 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a760f7-512d-432c-98d2-af37b76fada4 req-42d325d6-3015-4416-9fac-3d0c993b2455 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:06.378675 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-79a760f7-512d-432c-98d2-af37b76fada4 req-42d325d6-3015-4416-9fac-3d0c993b2455 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0796623
May 20 16:31:06.422874 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-79a760f7-512d-432c-98d2-af37b76fada4 req-e8130fdf-3a60-47d7-8970-36352ff65a3a tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0384910
May 20 16:31:06.445641 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40618) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:06.678669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b40125d3-c8c9-47d7-bab5-acb05dde95d6 tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92422) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:06.680271 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b40125d3-c8c9-47d7-bab5-acb05dde95d6 tempest-TestVolumeBootPattern-1816680056 tempest-TestVolumeBootPattern-1816680056-project-admin] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 1093 time: 0.2337382
May 20 16:31:06.683072 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40624) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:06.688260 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.v2.base [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Request body: {'floatingip': {'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'port_id': '561766a2-b146-4675-8333-f168ef61695c', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address': '172.20.0.7'}} {{(pid=92421) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 16:31:06.694099 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:31:06.698024 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Usage tracker for resource:floatingip and tenant:a6bd88ff65e9420a8ccb36968532c4f6 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:31:06.700816 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:31:06.707090 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:31:06.816829 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:06.950841 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:07.083855 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.db_base_plugin_common [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Allocated IP 172.27.0.142 (d2ac176c-a21a-4087-9111-35a566c1f2ad/1b34b0e6-e5e1-49f9-83e1-66292003e5f5/5a7f369c-82ba-4c6a-a1e8-0e294682b8bc) {{(pid=92421) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 16:31:07.227021 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:07.308483 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789402874974', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:07.312282 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c93050e9-9ed6-4a17-a0ff-8dae7437e100 tempest-AttachVolumeShelveTestJSON-204013317 tempest-AttachVolumeShelveTestJSON-204013317-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:07.375068 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Network d2ac176c-a21a-4087-9111-35a566c1f2ad is already hosted by enough agents. {{(pid=92421) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 16:31:07.377901 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.base_scheduler [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Resources bound (agent type, host, resource id):  {{(pid=92421) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 16:31:07.381529 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Received port after_create {{(pid=92421) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 16:31:07.415177 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=5a7f369c-82ba-4c6a-a1e8-0e294682b8bc,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:07.419101 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:07.883907 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:08.001043 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1000863'] for port, before_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:08.200592 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for port, precommit_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:08.258586 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789403239864', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789402874992', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789402875037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6100961'] for port, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:08.262452 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-358deb26-ac93-4d09-ace6-834d155ee2ed tempest-TestShelveInstance-1269738718 tempest-TestShelveInstance-1269738718-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:08.366108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event updated for resources: {'Port': ['ID=5a7f369c-82ba-4c6a-a1e8-0e294682b8bc,revision_number=2']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:08.369973 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:08.376746 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8331578'] for floatingip, after_update {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:08.548574 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Floating IP 6977cf58-d8ae-4085-865e-069797dbca58 associated. External IP: 172.27.0.142, port: 561766a2-b146-4675-8333-f168ef61695c.
May 20 16:31:08.891435 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:31:09.064993 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:31:09.074617 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:31:09.086764 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:31:09.087331 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71245e910>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:30:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:31:09.195977 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:09.263200 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-24b6191c-1594-47fe-adfd-3756a59b5f55 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.5678499
May 20 16:31:09.263200 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'tag': '561766a2-b146-4675-8333-f168ef61695c'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:31:09.264063 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:31:09.303040 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'tag': '561766a2-b146-4675-8333-f168ef61695c', 'status': 'completed', 'code': 200}
May 20 16:31:09.594459 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71245e910>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '6977cf58-d8ae-4085-865e-069797dbca58', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.142', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '561766a2-b146-4675-8333-f168ef61695c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 667, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:19:03:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:31:07Z', 'updated_at': '2021-05-20T16:31:07Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}, {'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:52Z', 'revision_number': 1, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:31:09.598234 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:31:09.606519 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:31:09.607101 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71245e910>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:30:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:31:09.779975 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:31:10.148778 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71245e910>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '6977cf58-d8ae-4085-865e-069797dbca58', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.142', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '561766a2-b146-4675-8333-f168ef61695c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 667, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:19:03:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:31:07Z', 'updated_at': '2021-05-20T16:31:07Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}, {'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:52Z', 'revision_number': 1, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:31:10.152429 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1a20692-058b-4854-b169-c543a93bdc42 None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '6977cf58-d8ae-4085-865e-069797dbca58', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.142', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '561766a2-b146-4675-8333-f168ef61695c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 667, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:19:03:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:31:07Z', 'updated_at': '2021-05-20T16:31:07Z', 'revision_number': 0, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}, {'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:52Z', 'revision_number': 1, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:31:10.285386 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-519280c2-3dcd-4d17-bb72-5e8ef4e7b367 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:10.286908 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-519280c2-3dcd-4d17-bb72-5e8ef4e7b367 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 1098 time: 0.0752690
May 20 16:31:10.341865 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84fe4e6-9fd5-4006-85d5-639eba355284 None None] New status for floating IP 6977cf58-d8ae-4085-865e-069797dbca58: ACTIVE {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:31:10.521667 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-c5460028-66a7-44c0-bc2a-4c16e6f7b0a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:10.523176 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-c5460028-66a7-44c0-bc2a-4c16e6f7b0a3 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.2290781
May 20 16:31:10.628426 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-039e7a84-3a6b-4e6a-8d11-fbeba1ed2717 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=561766a2-b146-4675-8333-f168ef61695c HTTP/1.1" status: 200  len: 999 time: 0.0975289
May 20 16:31:10.693865 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-9aa1a046-da3d-4f61-8a74-742308e1222f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:10.695495 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-9aa1a046-da3d-4f61-8a74-742308e1222f service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0601237
May 20 16:31:10.773925 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-bb3a1fb6-260b-4882-b35b-3a9489eae114 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:31:10.773925 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-bb3a1fb6-260b-4882-b35b-3a9489eae114 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0706317
May 20 16:31:10.903862 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-98b361ef-5ca0-42bb-ac77-ad25341165da service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1235149
May 20 16:31:11.034504 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-7d32ad54-edd5-484d-9d76-82b668de3e92 req-ca2366aa-e0eb-4750-a569-d6db7d835dc5 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1241305
May 20 16:31:15.875058 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-c0297137-7c3a-4557-b03c-73d0b1991c8c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.160174 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40794) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:18.286895 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.301431 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:31:18.305784 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Usage tracker for resource:security_group_rule and tenant:a71b63923d3c4910ba68dfa6edd2339e is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:31:18.308616 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:31:18.314623 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:31:18.399953 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.496881 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.531041 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.539076 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cf2d9f95-6ec1-48a1-aa96-c531bb52062e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:18.582658 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=a71b63923d3c4910ba68dfa6edd2339e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4213543
May 20 16:31:18.583628 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e00ab354-11ce-4107-af64-2c2d812b79b4,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:18.585946 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40814) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:18.587439 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-5cc0ace1-5bff-46ed-8d86-4c31355acec7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:18.640145 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-e5262a01-2d93-457c-9f54-56635a65e105 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.648183 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.675381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.784212 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.790059 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4ff9c60d-5ffe-43c9-8d5e-5bcd666db613 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:18.803951 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e00ab354-11ce-4107-af64-2c2d812b79b4,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:18.814286 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.816344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.816344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.816344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.816344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.816344 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.816884 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.816988 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.817253 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.817597 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.817938 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.818386 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:18.822160 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:18.823621 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:18.824802 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-04f24b13-44a1-43ba-acb2-1ea00f73d11a admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/e00ab354-11ce-4107-af64-2c2d812b79b4 HTTP/1.1" status: 204  len: 168 time: 0.2377546
May 20 16:31:19.691580 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:21.326668 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:29.463960 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:42.951415 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:31:45.874384 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-07ff98aa-7d80-4f5f-a8fc-122aed71a84f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:48.445226 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:48.639959 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-ded911c0-131e-41c9-8b8f-52ee2d03d2e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:48.806106 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40924) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:48.923336 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:48.937382 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:31:48.941633 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Usage tracker for resource:security_group_rule and tenant:669a88aa77414398917c1b1ce5aba632 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:31:48.944452 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:31:48.950057 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:31:49.032873 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:49.120041 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:49.128927 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ead8e3a0-32c9-4e66-b295-b10d94d778d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:49.167603 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=669a88aa77414398917c1b1ce5aba632&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3603525
May 20 16:31:49.169116 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68b6538a-3c04-4d52-8a69-1fa6d75dca07,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:49.170256 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40932) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:49.172414 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-067deb96-3253-471d-93b8-56e546525edb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:49.228605 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:49.253778 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:49.433614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:49.437211 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-36db71fa-4243-4189-b06a-34c193abd280 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:49.450577 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68b6538a-3c04-4d52-8a69-1fa6d75dca07,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:49.460373 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.460751 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.461118 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.461478 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.461879 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.462231 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.462586 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.462938 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.463320 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.463670 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.464020 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.464368 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:31:49.473228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:49.473228 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:49.473228 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-65c9eef5-7ff4-452f-88f9-76f5cba1c3c8 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/68b6538a-3c04-4d52-8a69-1fa6d75dca07 HTTP/1.1" status: 204  len: 168 time: 0.3008890
May 20 16:31:49.651599 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.089190 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 40964) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:51.202285 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.216451 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:31:51.220262 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Usage tracker for resource:security_group_rule and tenant:d4ed247f3ac34695be9c310698244b52 is out of sync, need to count used quota {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:31:51.223916 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92421) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:31:51.230393 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.quota.driver [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92421) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:31:51.303332 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.309767 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.388724 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.397301 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-d299f28c-d705-4f60-ab73-07ad758c7f67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:51.436341 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=d4ed247f3ac34695be9c310698244b52&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3460698
May 20 16:31:51.437849 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad6ac167-6f87-41fa-9cdc-b2fd31269b73,revision_number=1']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:51.439020 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 40970) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:31:51.440850 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-660e9e1b-d079-44b0-9200-48927b5b9e63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:51.498159 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-34abddfe-83b0-454a-a33b-b9c9ee885ee8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.523313 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-34abddfe-83b0-454a-a33b-b9c9ee885ee8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.650650 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-34abddfe-83b0-454a-a33b-b9c9ee885ee8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.654295 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-d94fb734-d0fc-4791-b731-ee0871613bf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:31:51.667332 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34abddfe-83b0-454a-a33b-b9c9ee885ee8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad6ac167-6f87-41fa-9cdc-b2fd31269b73,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:31:51.671070 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-34abddfe-83b0-454a-a33b-b9c9ee885ee8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:31:51.676493 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-34abddfe-83b0-454a-a33b-b9c9ee885ee8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:31:51.677607 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-34abddfe-83b0-454a-a33b-b9c9ee885ee8 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/ad6ac167-6f87-41fa-9cdc-b2fd31269b73 HTTP/1.1" status: 204  len: 168 time: 0.2375987
May 20 16:31:59.394036 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:05.130406 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-1eeda050-58a1-4dc8-bae2-3aa2972f4123 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1708589
May 20 16:32:05.238084 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41110) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:32:05.271994 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772fca66-905a-4f35-9708-0734ec8beaac req-1cc91bb5-7f95-452c-986f-49c16b0c902d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:32:05.273500 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-1cc91bb5-7f95-452c-986f-49c16b0c902d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1098 time: 0.0733759
May 20 16:32:05.359114 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Notify callbacks [] for security_group, before_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:05.377159 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 16:32:05.380983 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Usage tracker for resource:security_group_rule and tenant:8ff6be0bb89f4412aa2c75c7df1cb674 is out of sync, need to count used quota {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 16:32:05.383729 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.quota.resource [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92422) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 16:32:05.389319 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.quota.driver [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92422) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 16:32:05.418957 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772fca66-905a-4f35-9708-0734ec8beaac req-b41e601a-d46c-48ac-abcb-a773b144a448 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:32:05.420433 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-b41e601a-d46c-48ac-abcb-a773b144a448 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.1283050
May 20 16:32:05.470155 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:05.523726 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-ae77f5b7-9eb2-4486-8af6-35f46c3a861d service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 200  len: 1001 time: 0.0959351
May 20 16:32:05.536794 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_create {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:05.544641 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-604db3e3-b09f-478c-a689-d59fce7409fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:32:05.585259 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=8ff6be0bb89f4412aa2c75c7df1cb674&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3459747
May 20 16:32:05.586061 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772fca66-905a-4f35-9708-0734ec8beaac req-36cc0e69-1422-40e7-8053-db576860774c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:32:05.586206 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5bbaa22c-5e9d-4b0d-a162-80cc03f7b624,revision_number=1']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:32:05.587616 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-36cc0e69-1422-40e7-8053-db576860774c service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0573263
May 20 16:32:05.588069 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 41116) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:32:05.589381 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:32:05.705218 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-78b014c5-995d-407a-b7b9-eeb84a2351b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:05.720172 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772fca66-905a-4f35-9708-0734ec8beaac req-803ce300-d497-4b1d-aca0-7adf56b60c56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:32:05.721617 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-803ce300-d497-4b1d-aca0-7adf56b60c56 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.1220016
May 20 16:32:05.754781 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-78b014c5-995d-407a-b7b9-eeb84a2351b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:05.973114 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-2745d2fa-6444-4d92-a5f0-a5884304d3e8 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2421882
May 20 16:32:06.059767 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-78b014c5-995d-407a-b7b9-eeb84a2351b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:06.068889 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-cefa5a9c-6147-4a74-abec-b6dcc16b46e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:32:06.095588 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b014c5-995d-407a-b7b9-eeb84a2351b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5bbaa22c-5e9d-4b0d-a162-80cc03f7b624,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:32:06.099288 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-78b014c5-995d-407a-b7b9-eeb84a2351b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:32:06.111659 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-78b014c5-995d-407a-b7b9-eeb84a2351b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:06.112779 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-78b014c5-995d-407a-b7b9-eeb84a2351b6 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/5bbaa22c-5e9d-4b0d-a162-80cc03f7b624 HTTP/1.1" status: 204  len: 168 time: 0.5238070
May 20 16:32:06.130750 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-772fca66-905a-4f35-9708-0734ec8beaac req-8f37c7f2-eeee-4f6c-b794-1d0086b4e94b service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1500053
May 20 16:32:07.854490 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [req-8cd6f679-09f2-452f-980d-667f063a2147 req-f3b50201-3999-4553-ae69-3e3d85180628 service neutron] (92422) timed out ('10.222.0.16', 54666) {{(pid=92422) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 20 16:32:08.518588 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [req-19bd9f1d-e538-4cb6-951f-af043313640c req-8b830c2c-c758-46b1-be2e-db2f7baf76b9 service neutron] (92421) timed out ('10.222.0.16', 54644) {{(pid=92421) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 20 16:32:15.878885 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-28ce76e8-41dd-419b-96ce-dea9d53189d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:18.450852 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:18.679035 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-87a2b609-15fb-44b3-b0ea-aa57649b6eb0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:19.655935 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:19.950419 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:32:21.331151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:29.405178 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:45.895580 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-1a5bd02c-3528-40ef-a3cd-068ee00acd06 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:48.472882 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:48.649776 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-b056a8f7-3a36-45ec-a1fa-2d7bc5cc6668 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:49.661581 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:51.284725 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:32:56.949878 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:32:59.426580 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:07.029626 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-3636db79-9ce2-4c26-8935-e172f6c97544 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0701113
May 20 16:33:07.118186 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8219dd19-298c-4b7e-a688-512e43c85881 req-4b670f19-26fa-446f-b43f-a524b43f6b78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:07.119644 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-4b670f19-26fa-446f-b43f-a524b43f6b78 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 1098 time: 0.0699008
May 20 16:33:07.263042 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8219dd19-298c-4b7e-a688-512e43c85881 req-3918d488-e77e-4ddb-933f-aa7201e90662 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:07.264522 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-3918d488-e77e-4ddb-933f-aa7201e90662 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.1260564
May 20 16:33:07.366370 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-80af5741-0e62-4daa-8115-c52f04852623 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=561766a2-b146-4675-8333-f168ef61695c HTTP/1.1" status: 200  len: 1001 time: 0.0955250
May 20 16:33:07.430609 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8219dd19-298c-4b7e-a688-512e43c85881 req-0fe72ffa-df96-4292-afb8-de1e7dcad3ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:07.432024 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-0fe72ffa-df96-4292-afb8-de1e7dcad3ff service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0601156
May 20 16:33:07.505482 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8219dd19-298c-4b7e-a688-512e43c85881 req-9c85339a-c99f-4f28-9f14-9d03a883ed13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:07.506904 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-9c85339a-c99f-4f28-9f14-9d03a883ed13 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0688467
May 20 16:33:07.637644 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-71047e43-79ce-485e-b7dd-38e8cf775e18 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1242490
May 20 16:33:07.767205 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-8219dd19-298c-4b7e-a688-512e43c85881 req-2bd04d4c-cfd0-44d8-8363-934c6d5ad976 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1238778
May 20 16:33:12.749436 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.wsgi [-] (92421) accepted ('10.222.0.64', 41142) {{(pid=92421) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:13.011460 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Deleting port 5a7f369c-82ba-4c6a-a1e8-0e294682b8bc {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:13.011717 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:13.127157 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:13.127512 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:13.336033 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Calling delete_port for 5a7f369c-82ba-4c6a-a1e8-0e294682b8bc owned by network:floatingip {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:13.529661 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:13.534213 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-c1535912-3554-4752-ad8d-7192b6fdde04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:13.576957 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event deleted for resources: {'Port': ['ID=5a7f369c-82ba-4c6a-a1e8-0e294682b8bc,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:13.613313 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.613615 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.613976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.614342 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.614680 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.615034 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.615413 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.615761 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.616108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.616452 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.616796 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.617134 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92421) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:13.624867 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:13.681078 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:13.681409 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.db.l3_db [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Floating IP 6977cf58-d8ae-4085-865e-069797dbca58 disassociated (deleted). External IP: 172.27.0.142, port: 561766a2-b146-4675-8333-f168ef61695c.
May 20 16:33:14.021558 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92421) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:33:14.197936 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92421) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:33:14.207389 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:33:14.216224 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:14.223954 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711f65dc0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:32:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:14.273071 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:14.326575 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [None req-75bb334e-f05d-4fc1-a2b0-6a72bf767631 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "DELETE /v2.0/floatingips/6977cf58-d8ae-4085-865e-069797dbca58 HTTP/1.1" status: 204  len: 168 time: 1.5760646
May 20 16:33:14.327233 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'tag': '561766a2-b146-4675-8333-f168ef61695c'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:33:14.399508 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:14.569417 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'tag': '561766a2-b146-4675-8333-f168ef61695c', 'status': 'completed', 'code': 200}
May 20 16:33:14.663667 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-36565e8e-9aea-40dd-ba04-bf835f284cef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:14.665134 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-36565e8e-9aea-40dd-ba04-bf835f284cef service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 1098 time: 0.0743344
May 20 16:33:14.745167 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711f65dc0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:52Z', 'revision_number': 1, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:14.748869 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:33:14.757167 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:14.757755 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe711f65dc0>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:32:49Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:14.797320 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-31e07b1c-61d6-40ec-8a1b-d8ea8a9d1499 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:14.798690 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-31e07b1c-61d6-40ec-8a1b-d8ea8a9d1499 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.1277249
May 20 16:33:14.867562 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-bb648bf3-b737-4cb5-97ef-f76e6159a14f service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=561766a2-b146-4675-8333-f168ef61695c HTTP/1.1" status: 200  len: 217 time: 0.0593927
May 20 16:33:14.931016 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:14.931840 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-570e63ef-33c9-49f7-9722-a690a193007c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:14.933297 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-570e63ef-33c9-49f7-9722-a690a193007c service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.0600977
May 20 16:33:15.009291 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-477f89c3-4084-4c1c-8d4a-5ae2df726a2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:15.010793 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-477f89c3-4084-4c1c-8d4a-5ae2df726a2f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0716908
May 20 16:33:15.244984 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-e6f9dd5e-8b43-4aef-bc2a-6dab68af35e0 service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2263410
May 20 16:33:15.320394 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe711f65dc0>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:52Z', 'revision_number': 1, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:15.324455 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd232d9a-8ee0-4690-bf56-97110494286d None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_floatingips': [{'id': '8eb78320-222d-470c-97be-892e78e1e72e', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'floating_ip_address': '172.27.0.179', 'floating_network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'router_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'port_id': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'mac_address': 'fa:16:3e:b9:3c:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7873cbca-103b-461c-aeb9-5c586df4811b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T16:27:49Z', 'updated_at': '2021-05-20T16:27:52Z', 'revision_number': 1, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:33:15.383452 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c32a4aff-6283-42b7-b47c-58f45575c049 req-da7ba544-dba9-4302-8fe5-fa322a87940e service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1319323
May 20 16:33:15.532259 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6f00eea-4835-4738-9f68-e622d3e450dd None None] New status for floating IP 6977cf58-d8ae-4085-865e-069797dbca58: DOWN {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:33:15.873066 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-30a9b16f-4be2-48af-9b1a-4ef90bd9773f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:16.009880 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a20d684-14d1-4546-9da6-490aa7c9b82e req-77f08d4f-61ce-4c68-89d0-8a9a74bd14bb tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:16.010555 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-4a20d684-14d1-4546-9da6-490aa7c9b82e req-77f08d4f-61ce-4c68-89d0-8a9a74bd14bb tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:33:16.071976 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-4a20d684-14d1-4546-9da6-490aa7c9b82e req-77f08d4f-61ce-4c68-89d0-8a9a74bd14bb tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:33:16.073115 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4a20d684-14d1-4546-9da6-490aa7c9b82e req-77f08d4f-61ce-4c68-89d0-8a9a74bd14bb tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.2500398
May 20 16:33:16.118240 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-4a20d684-14d1-4546-9da6-490aa7c9b82e req-b58d5df1-b417-47e9-87be-b57b4426c9a6 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393000
May 20 16:33:17.355124 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc23938-0a0f-49d5-a0bb-0fb3af41efd1 req-481aaea0-ead2-4265-93a5-4539edfedc8c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:17.356599 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dbc23938-0a0f-49d5-a0bb-0fb3af41efd1 req-481aaea0-ead2-4265-93a5-4539edfedc8c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.1269894
May 20 16:33:17.400627 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-dbc23938-0a0f-49d5-a0bb-0fb3af41efd1 req-008c9dfd-8e02-4142-a618-c62bee39ebca tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382609
May 20 16:33:17.691728 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-2f796088-f214-4423-b179-e9d551ac705c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:17.693065 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-2f796088-f214-4423-b179-e9d551ac705c tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 945 time: 0.0833735
May 20 16:33:17.826326 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Deleting port 561766a2-b146-4675-8333-f168ef61695c {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:17.826673 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:17.955614 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] For port 561766a2-b146-4675-8333-f168ef61695c, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=561766a2-b146-4675-8333-f168ef61695c,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:17.955890 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:18.074809 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Calling delete_port for 561766a2-b146-4675-8333-f168ef61695c owned by compute:nova {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:18.244263 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:18.249645 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:18.298072 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event deleted for resources: {'Port': ['ID=561766a2-b146-4675-8333-f168ef61695c,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:18.301285 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:18.373756 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] No DVR routers for this DVR port 561766a2-b146-4675-8333-f168ef61695c on host hv-cinder-68948 {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:33:18.376250 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:18.379370 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'name': 'network-vif-deleted', 'tag': '561766a2-b146-4675-8333-f168ef61695c'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:33:18.424111 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fc113a07-d4eb-4496-aa66-02937f3b9fc6', 'name': 'network-vif-deleted', 'tag': '561766a2-b146-4675-8333-f168ef61695c', 'status': 'completed', 'code': 200}
May 20 16:33:18.456358 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-28c924cf-2bb7-46e2-98e9-195e20be5689 req-0e9b036f-d148-428d-b6ac-8b523e0f63c0 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "DELETE /v2.0/ports/561766a2-b146-4675-8333-f168ef61695c HTTP/1.1" status: 204  len: 173 time: 0.7583177
May 20 16:33:18.495985 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:18.546757 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-73c7d204-defc-42bf-a2fe-20b5759e0a41 req-c51138d6-b651-4ab9-bb8b-f07a77aefe47 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:33:18.621632 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-73c7d204-defc-42bf-a2fe-20b5759e0a41 req-c51138d6-b651-4ab9-bb8b-f07a77aefe47 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:33:18.622862 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-73c7d204-defc-42bf-a2fe-20b5759e0a41 req-c51138d6-b651-4ab9-bb8b-f07a77aefe47 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 210 time: 0.1168363
May 20 16:33:18.650168 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-dea331f4-d933-45aa-bf4c-743776448edf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:19.770470 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:19.798441 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-3bb6174f-5d02-4a23-b7aa-9acd0e58ff8d req-4eab10ff-9f1c-4666-bd22-c3c4d170068f tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=fc113a07-d4eb-4496-aa66-02937f3b9fc6 HTTP/1.1" status: 200  len: 210 time: 0.0433631
May 20 16:33:21.294556 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:21.417675 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 561766a2-b146-4675-8333-f168ef61695c no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:21.453978 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 561766a2-b146-4675-8333-f168ef61695c {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:21.454349 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 561766a2-b146-4675-8333-f168ef61695c not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:23.465705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41202) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:23.817681 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Deleting port a3882e96-332a-4c5a-b86e-e105d3e44a16 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:23.818025 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:23.932973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:23.933302 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:24.053370 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Calling delete_port for a3882e96-332a-4c5a-b86e-e105d3e44a16 owned by network:floatingip {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:24.226793 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:24.230350 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-74199216-50f6-4672-aaab-b135013438ca service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:24.274143 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event deleted for resources: {'Port': ['ID=a3882e96-332a-4c5a-b86e-e105d3e44a16,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:24.317339 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.317709 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.318079 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.318441 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.318796 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.319154 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.319536 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.319892 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.320245 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.320595 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.320945 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.321292 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92422) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:24.351140 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:24.379230 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:24.379597 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.db.l3_db [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Floating IP 8eb78320-222d-470c-97be-892e78e1e72e disassociated (deleted). External IP: 172.27.0.179, port: 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9.
May 20 16:33:24.723972 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:33:24.899984 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:33:24.909151 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:33:24.918379 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:24.918990 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712f36730>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:33:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:24.988215 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:25.042636 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "DELETE /v2.0/floatingips/8eb78320-222d-470c-97be-892e78e1e72e HTTP/1.1" status: 204  len: 168 time: 1.5758095
May 20 16:33:25.043506 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9'}] {{(pid=92422) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:33:25.093997 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:25.150033 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'status': 'completed', 'code': 200}
May 20 16:33:25.245364 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511968c-ba79-46cd-845f-c2073ab0307a req-2248ed8e-d66e-42f5-af60-57f0e9aaad8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:25.246731 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c511968c-ba79-46cd-845f-c2073ab0307a req-2248ed8e-d66e-42f5-af60-57f0e9aaad8f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 1098 time: 0.0747595
May 20 16:33:25.385615 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511968c-ba79-46cd-845f-c2073ab0307a req-0a706ed0-49e0-4ba7-b8d9-6e4706098784 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:25.388348 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c511968c-ba79-46cd-845f-c2073ab0307a req-0a706ed0-49e0-4ba7-b8d9-6e4706098784 service neutron] 10.222.0.16 "GET /v2.0/networks?id=a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 200  len: 913 time: 0.1350937
May 20 16:33:25.411936 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712f36730>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:25.415744 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:33:25.423995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:25.424598 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe712f36730>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:33:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:25.460317 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c511968c-ba79-46cd-845f-c2073ab0307a req-65faca22-16f4-4e12-abc5-54a8d97ad420 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 200  len: 217 time: 0.0609276
May 20 16:33:25.609029 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:25.662823 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511968c-ba79-46cd-845f-c2073ab0307a req-29cd6ba4-883b-463d-bc51-878e1135c8fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:25.664303 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c511968c-ba79-46cd-845f-c2073ab0307a req-29cd6ba4-883b-463d-bc51-878e1135c8fe service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 200  len: 851 time: 0.1985602
May 20 16:33:25.757497 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e63420-98b8-467e-ab1b-f6177452d4cb req-3ae93bb7-3df7-4e07-b1b3-d91f5cc926d5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:25.758856 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76e63420-98b8-467e-ab1b-f6177452d4cb req-3ae93bb7-3df7-4e07-b1b3-d91f5cc926d5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 945 time: 0.1546481
May 20 16:33:25.769024 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511968c-ba79-46cd-845f-c2073ab0307a req-e008e6ae-ec2a-4c2b-9722-dcd4b9673250 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:25.770476 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c511968c-ba79-46cd-845f-c2073ab0307a req-e008e6ae-ec2a-4c2b-9722-dcd4b9673250 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a02876f9-a796-4512-9044-eb08bb5d54c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1176 time: 0.0973940
May 20 16:33:25.897966 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-76e63420-98b8-467e-ab1b-f6177452d4cb req-a021c8fa-87df-4d43-97ba-28a14bfb7db3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/security-groups?id=da77fa6e-aadb-4acb-8e30-527bbdccd591&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1265354
May 20 16:33:25.936285 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c511968c-ba79-46cd-845f-c2073ab0307a req-44e24a5c-f32b-417a-921f-96cd540f7deb service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1519027
May 20 16:33:25.963498 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe712f36730>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:25.967429 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef3144c7-edf1-4717-85a6-667977d4ddfc None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:23:36Z', 'revision_number': 4, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi', '_interfaces': [{'id': '86ac85fa-8a31-4e3a-b3db-3c8302d1748d', 'name': '', 'network_id': 'a02876f9-a796-4512-9044-eb08bb5d54c6', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'mac_address': 'fa:16:3e:6a:4d:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:35Z', 'updated_at': '2021-05-20T16:23:42Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'subnets': [{'id': 'cb578eb9-d6e8-4e33-8d08-43894fe771d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:33:26.070236 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-c511968c-ba79-46cd-845f-c2073ab0307a req-9bf167d4-0c6c-4021-a3b9-eaee21a86bdb service neutron] 10.222.0.16 "GET /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1272848
May 20 16:33:26.165513 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37be7366-fc8e-4d4d-b58a-c2e42b530253 None None] New status for floating IP 8eb78320-222d-470c-97be-892e78e1e72e: DOWN {{(pid=92424) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 16:33:26.243590 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-9b519659-44b4-4fa9-af49-a3af099b6660 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92421) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 16:33:26.245012 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-9b519659-44b4-4fa9-af49-a3af099b6660 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 945 time: 0.0796473
May 20 16:33:26.384409 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Deleting port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 {{(pid=92421) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:26.385066 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:26.515371 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.db [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] For port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9, host hv-cinder-68948, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-68948',level=0,port_id=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92421) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:26.515723 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:26.639657 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.plugins.ml2.plugin [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Calling delete_port for 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 owned by compute:nova {{(pid=92421) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:26.804116 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6100968'] for port, after_delete {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:26.809585 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-bb130d1c-cb40-451d-ab4e-29724708a342 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:26.852108 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event deleted for resources: {'Port': ['ID=5ac737cf-18db-4859-93ae-3ce4c7a6e5c9,revision_number=None']} {{(pid=92421) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:26.855462 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG oslo_concurrency.lockutils [None req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:26.930821 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.db.l3_dvrscheduler_db [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] No DVR routers for this DVR port 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 on host hv-cinder-68948 {{(pid=92421) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:33:26.933291 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron_lib.callbacks.manager [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for port, before_response {{(pid=92421) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:26.935877 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'name': 'network-vif-deleted', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9'}] {{(pid=92421) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 16:33:26.948356 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-f67d692c-cf28-48eb-8d8b-93ab2915ad3a req-e8c8dcf5-82a0-4e55-864c-5f1387a6abe5 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.16 "DELETE /v2.0/ports/5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 HTTP/1.1" status: 204  len: 173 time: 0.6977851
May 20 16:33:27.000344 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7873cbca-103b-461c-aeb9-5c586df4811b', 'name': 'network-vif-deleted', 'tag': '5ac737cf-18db-4859-93ae-3ce4c7a6e5c9', 'status': 'completed', 'code': 200}
May 20 16:33:27.062353 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-1d2b1e6f-e4d2-4e9a-b1fd-3e7d126c2fc6 req-e9f1d5e6-9fd9-4248-87bf-a4cf4d6c56ba tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Synchronizing usage tracker for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 16:33:27.174551 dv-cinder-689486-13-iscsi neutron-server[92421]: DEBUG neutron.quota.resource [req-1d2b1e6f-e4d2-4e9a-b1fd-3e7d126c2fc6 req-e9f1d5e6-9fd9-4248-87bf-a4cf4d6c56ba tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Unset dirty status for tenant:a6bd88ff65e9420a8ccb36968532c4f6 on resource:port {{(pid=92421) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 16:33:27.175723 dv-cinder-689486-13-iscsi neutron-server[92421]: INFO neutron.wsgi [req-1d2b1e6f-e4d2-4e9a-b1fd-3e7d126c2fc6 req-e9f1d5e6-9fd9-4248-87bf-a4cf4d6c56ba tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "GET /v2.0/ports?device_id=7873cbca-103b-461c-aeb9-5c586df4811b HTTP/1.1" status: 200  len: 210 time: 0.1549106
May 20 16:33:28.271871 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41224) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:28.594687 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Deleting port 714997cf-7ef6-4ebf-b6d9-21085584b249 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:28.595020 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:28.708068 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:28.708389 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:28.824621 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Calling delete_port for 714997cf-7ef6-4ebf-b6d9-21085584b249 owned by network:floatingip {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:29.002917 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:29.008199 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-1d6c7a47-4025-4b55-8115-7e0cc6a90c60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:29.050314 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event deleted for resources: {'Port': ['ID=714997cf-7ef6-4ebf-b6d9-21085584b249,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:29.081188 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:29.140199 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for floatingip, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:29.241960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-429512'] for floatingip, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:29.243123 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-6cbc5b79-ba75-4309-8ab4-91ce1fc81a99 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "DELETE /v2.0/floatingips/90d279ad-f91e-4479-bd2a-ff38cba18b35 HTTP/1.1" status: 204  len: 168 time: 0.9702673
May 20 16:33:29.408718 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:29.443125 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 no longer exists at agent hyperv_hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:29.476644 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] No Port match for: 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:29.476989 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Device 5ac737cf-18db-4859-93ae-3ce4c7a6e5c9 not bound to the agent host hv-cinder-68948 {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:30.760879 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41238) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:30.828236 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2e66d1b0-f79a-4df9-baa2-0dd1745208f3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:30.856985 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2e66d1b0-f79a-4df9-baa2-0dd1745208f3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:30.980219 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2e66d1b0-f79a-4df9-baa2-0dd1745208f3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:30.983836 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b1dfeaf6-d060-43db-9027-c9eebcd04d29 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:30.997960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e66d1b0-f79a-4df9-baa2-0dd1745208f3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=da77fa6e-aadb-4acb-8e30-527bbdccd591,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:31.001063 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-2e66d1b0-f79a-4df9-baa2-0dd1745208f3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:31.076073 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-2e66d1b0-f79a-4df9-baa2-0dd1745208f3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:31.077231 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-2e66d1b0-f79a-4df9-baa2-0dd1745208f3 tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] 10.222.0.64 "DELETE /v2.0/security-groups/da77fa6e-aadb-4acb-8e30-527bbdccd591 HTTP/1.1" status: 204  len: 168 time: 0.3153777
May 20 16:33:32.206576 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41246) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:32.834162 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:33.327959 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Deleting port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:33.328591 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:33.445322 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] For port 86ac85fa-8a31-4e3a-b3db-3c8302d1748d, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:33.445674 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:33.566394 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Calling delete_port for 86ac85fa-8a31-4e3a-b3db-3c8302d1748d owned by network:router_interface {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:33.752725 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:33.757645 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-470879db-e66a-4b97-a91c-e423b3e890f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:33.801731 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Pushing event deleted for resources: {'Port': ['ID=86ac85fa-8a31-4e3a-b3db-3c8302d1748d,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:33.805509 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:33.948337 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:33:34.066330 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:34.408706 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Router 93062e7a-bead-41af-9c53-263e03cf34ac has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:33:34.680597 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:33:34.688847 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] Sync routers for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:33:34.693325 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-6157f43d-f582-42c6-84ba-e940ba5e806c admin admin] 10.222.0.64 "PUT /v2.0/routers/93062e7a-bead-41af-9c53-263e03cf34ac/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4851530
May 20 16:33:34.695743 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41252) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:34.698201 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:34.698813 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71204bf40>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:33:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:34.866514 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks [] for router, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:34.870081 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: dv-cinder-689486-13-iscsi {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:35.037280 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:35.150492 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71204bf40>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41'}], 'enable_snat': True}, 'gw_port_id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:33:33Z', 'revision_number': 5, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port': {'id': '87b02c72-143f-485c-ad40-ea2a7cb6de7f', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:23:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:32Z', 'updated_at': '2021-05-20T16:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:35.154388 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] Checking router: 93062e7a-bead-41af-9c53-263e03cf34ac for host: dv-cinder-689486-13-iscsi {{(pid=92423) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:33:35.162836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] Routers {'93062e7a-bead-41af-9c53-263e03cf34ac'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92423) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:35.163487 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe71204bf40>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:33:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['93062e7a-bead-41af-9c53-263e03cf34ac'], 'active': True} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:35.169634 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Deleting port 87b02c72-143f-485c-ad40-ea2a7cb6de7f {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:35.169973 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:35.294436 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] For port 87b02c72-143f-485c-ad40-ea2a7cb6de7f, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=87b02c72-143f-485c-ad40-ea2a7cb6de7f,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:35.294776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:35.314357 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvr_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] Set router 93062e7a-bead-41af-9c53-263e03cf34ac gateway port host: None {{(pid=92423) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:35.414951 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Calling delete_port for 87b02c72-143f-485c-ad40-ea2a7cb6de7f owned by network:router_gateway {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:35.421744 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_hamode_db [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe71204bf40>, [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:33:35Z', 'revision_number': 6, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port_host': None}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92423) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:35.425743 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16feb2ca-a5c7-43d2-b4c7-73ce98618daa None None] The sync data for ids ['93062e7a-bead-41af-9c53-263e03cf34ac'] in dv-cinder-689486-13-iscsi is: [{'id': '93062e7a-bead-41af-9c53-263e03cf34ac', 'name': 'tempest-TestVolumeBootPattern-1569236740-router', 'tenant_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:31Z', 'updated_at': '2021-05-20T16:33:35Z', 'revision_number': 6, 'project_id': 'a6bd88ff65e9420a8ccb36968532c4f6', 'gw_port_host': None}] {{(pid=92423) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:33:35.642564 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:35.647466 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-73dbd390-4ee5-4f4f-9b2f-0e9c36e89daa tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:35.689152 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Pushing event deleted for resources: {'Port': ['ID=87b02c72-143f-485c-ad40-ea2a7cb6de7f,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:35.692260 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:35.781331 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:35.953551 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:35.955685 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.145401 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.146552 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 93062e7a-bead-41af-9c53-263e03cf34ac {{(pid=92422) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:33:36.159620 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.161320 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] 10.222.0.64 "DELETE /v2.0/routers/93062e7a-bead-41af-9c53-263e03cf34ac HTTP/1.1" status: 204  len: 168 time: 1.4640913
May 20 16:33:36.163389 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41256) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:36.223574 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 86ac85fa-8a31-4e3a-b3db-3c8302d1748d no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:36.224204 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Deleting subnet cb578eb9-d6e8-4e33-8d08-43894fe771d7 {{(pid=92422) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:33:36.226976 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.262758 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 86ac85fa-8a31-4e3a-b3db-3c8302d1748d {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:36.263112 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 86ac85fa-8a31-4e3a-b3db-3c8302d1748d not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:36.281119 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6219245'] for subnet, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.358783 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.701705 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6358801', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6223409'] for subnet, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.706553 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:36.740768 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cb578eb9-d6e8-4e33-8d08-43894fe771d7,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:36.743722 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:36.745447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.749650 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e899e363-8326-4fc3-ac68-65311645ca65 None None] Network a02876f9-a796-4512-9044-eb08bb5d54c6 requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:33:36.750602 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-9b634bd9-1342-4ede-a0f4-ca6ca11b2c4f admin admin] 10.222.0.64 "DELETE /v2.0/subnets/cb578eb9-d6e8-4e33-8d08-43894fe771d7 HTTP/1.1" status: 204  len: 168 time: 0.5862904
May 20 16:33:36.753074 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41260) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:36.857629 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.927025 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Deleting port f32cfc28-580f-41b9-bde1-3682c8975a1b {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:36.927991 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:36.986583 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] DHCP port deletion for a02876f9-a796-4512-9044-eb08bb5d54c6 request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:33:37.029960 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] For port f32cfc28-580f-41b9-bde1-3682c8975a1b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=f32cfc28-580f-41b9-bde1-3682c8975a1b,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:37.030321 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.053113 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Deleting port f32cfc28-580f-41b9-bde1-3682c8975a1b {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:37.053489 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.147992 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] For port f32cfc28-580f-41b9-bde1-3682c8975a1b, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=f32cfc28-580f-41b9-bde1-3682c8975a1b,segment=NetworkSegment(fc044b53-c97e-4bc3-a994-fbd15cd4e0a2),segment_id=fc044b53-c97e-4bc3-a994-fbd15cd4e0a2)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:37.148385 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.152373 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Calling delete_port for f32cfc28-580f-41b9-bde1-3682c8975a1b owned by network:dhcp {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:37.238837 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.242816 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-77b5d24d-315c-4b05-b61a-8f73392184f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:37.285874 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Pushing event deleted for resources: {'Port': ['ID=f32cfc28-580f-41b9-bde1-3682c8975a1b,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:37.289421 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:37.290199 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] No DVR routers for this DVR port f32cfc28-580f-41b9-bde1-3682c8975a1b on host dv-cinder-689486-13-iscsi {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:33:37.305513 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Calling delete_port for f32cfc28-580f-41b9-bde1-3682c8975a1b owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:37.346911 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.351943 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:37.394134 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] No DVR routers for this DVR port f32cfc28-580f-41b9-bde1-3682c8975a1b on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:33:37.400957 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Pushing event deleted for resources: {'Port': ['ID=f32cfc28-580f-41b9-bde1-3682c8975a1b,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:37.404299 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.407616 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.408003 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.408434 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.408714 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.409043 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.409372 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.409723 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.410044 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.410365 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.410718 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.411033 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.411470 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-689486-13-iscsi {{(pid=92423) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 16:33:37.415023 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-65ff3ed5-6d9f-4915-9556-58bd482a289e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:37.418211 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe711122fa0>,) {'filters': {'network_id': ['a02876f9-a796-4512-9044-eb08bb5d54c6']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:37.429984 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711122fa0>, 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:37.430276 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe711122fa0>, 'fc044b53-c97e-4bc3-a994-fbd15cd4e0a2') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:37.441423 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.456951 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.463562 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Releasing vlan 637 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:33:37.463965 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:33:37.477835 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:33:37.638654 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.642282 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-e069e84f-0c60-463e-971d-c6d8085ab5e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:37.658379 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:37.667103 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Pushing event deleted for resources: {'Network': ['ID=a02876f9-a796-4512-9044-eb08bb5d54c6,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:37.671140 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:37.730409 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-ab9c4fc1-a701-4d80-8190-e31f0636267f admin admin] 10.222.0.64 "DELETE /v2.0/networks/a02876f9-a796-4512-9044-eb08bb5d54c6 HTTP/1.1" status: 204  len: 168 time: 0.9763629
May 20 16:33:37.733201 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41264) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:37.887490 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device f32cfc28-580f-41b9-bde1-3682c8975a1b no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:37.925465 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: f32cfc28-580f-41b9-bde1-3682c8975a1b {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:37.925757 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device f32cfc28-580f-41b9-bde1-3682c8975a1b not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:37.926140 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 87b02c72-143f-485c-ad40-ea2a7cb6de7f no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:37.960270 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: 87b02c72-143f-485c-ad40-ea2a7cb6de7f {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:37.960622 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device 87b02c72-143f-485c-ad40-ea2a7cb6de7f not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:38.354039 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8302628'] for router_interface, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:38.753332 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Deleting port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:38.754016 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:38.872422 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] For port e6c1dc32-2719-4c4c-b313-b944d4fcaaa9, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,segment=NetworkSegment(a1311d2e-3e3b-40e6-b792-506a50d6801e),segment_id=a1311d2e-3e3b-40e6-b792-506a50d6801e)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:38.872776 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:38.993756 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Calling delete_port for e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 owned by network:router_interface {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:39.186580 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:39.191014 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-4f543cee-f342-41df-8645-e974467b4fe9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:39.234374 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Pushing event deleted for resources: {'Port': ['ID=e6c1dc32-2719-4c4c-b313-b944d4fcaaa9,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:39.260016 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:39.598515 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8347571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8302736'] for router_interface, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:39.947508 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Router f5f03d8e-8074-4a54-9b67-292c322d1f4f has already been hosted by L3 agent 51187059-4d42-414b-9c82-7d2e4e3810d2 {{(pid=92422) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 16:33:40.121299 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] Notify agent at l3_agent.dv-cinder-689486-13-iscsi the message routers_updated {{(pid=92422) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 16:33:40.129771 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] Sync routers for ids ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'] in dv-cinder-689486-13-iscsi {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 16:33:40.138912 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] Routers {'f5f03d8e-8074-4a54-9b67-292c322d1f4f'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:40.139550 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe713774c70>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:33:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:40.222157 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-accfaae6-1a34-4481-b8cc-892fc36ab43e admin admin] 10.222.0.64 "PUT /v2.0/routers/f5f03d8e-8074-4a54-9b67-292c322d1f4f/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4878631
May 20 16:33:40.225146 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41268) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:40.338687 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] Set router f5f03d8e-8074-4a54-9b67-292c322d1f4f gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:40.399138 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks [] for router, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:40.571019 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:40.614560 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe713774c70>, [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:33:39Z', 'revision_number': 5, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:40.618299 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] Checking router: f5f03d8e-8074-4a54-9b67-292c322d1f4f for host: dv-cinder-689486-13-iscsi {{(pid=92424) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 16:33:40.626518 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] Routers {'f5f03d8e-8074-4a54-9b67-292c322d1f4f'} bound to L3 agent in host dv-cinder-689486-13-iscsi {{(pid=92424) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 16:33:40.627105 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe713774c70>, 'dv-cinder-689486-13-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T16:08:49Z,description=<?>,heartbeat_timestamp=2021-05-20T16:33:19Z,host='dv-cinder-689486-13-iscsi',id=51187059-4d42-414b-9c82-7d2e4e3810d2,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T16:08:49Z,topic='l3_agent')) {'router_ids': ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'], 'active': True} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:40.747255 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Deleting port ee2018aa-6613-4ac5-83ac-f85e6ec6201a {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:40.747523 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:40.800997 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_dvr_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] Set router f5f03d8e-8074-4a54-9b67-292c322d1f4f gateway port host: dv-cinder-689486-13-iscsi {{(pid=92424) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 16:33:40.866471 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] For port ee2018aa-6613-4ac5-83ac-f85e6ec6201a, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,segment=NetworkSegment(994c7083-9ec0-4a20-afb4-ae32a10fcc1c),segment_id=994c7083-9ec0-4a20-afb4-ae32a10fcc1c)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:40.866829 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.078176 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.l3_hamode_db [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe713774c70>, [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:33:39Z', 'revision_number': 5, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}], 'dv-cinder-689486-13-iscsi', False) {} {{(pid=92424) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:41.082304 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37ef9fc4-55e6-41d8-9d31-8dc97c488772 None None] The sync data for ids ['f5f03d8e-8074-4a54-9b67-292c322d1f4f'] in dv-cinder-689486-13-iscsi is: [{'id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'name': 'tempest-TestVolumeBootPattern-1981266298-router', 'tenant_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'external_fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T16:23:42Z', 'updated_at': '2021-05-20T16:33:39Z', 'revision_number': 5, 'project_id': '3c8d0c7d5c7f420f878c3ea95df7af77', 'gw_port': {'id': 'ee2018aa-6613-4ac5-83ac-f85e6ec6201a', 'name': '', 'network_id': 'd2ac176c-a21a-4087-9111-35a566c1f2ad', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:7e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5f03d8e-8074-4a54-9b67-292c322d1f4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-689486-13-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T16:23:43Z', 'updated_at': '2021-05-20T16:23:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1b34b0e6-e5e1-49f9-83e1-66292003e5f5', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-689486-13-iscsi'}] {{(pid=92424) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 16:33:41.101708 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Calling delete_port for ee2018aa-6613-4ac5-83ac-f85e6ec6201a owned by network:router_gateway {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:41.312913 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.317923 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-04793665-e924-4d69-86a3-e317e8d876cd tempest-TestVolumeBootPattern-1806296471 tempest-TestVolumeBootPattern-1806296471-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:41.385846 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Pushing event deleted for resources: {'Port': ['ID=ee2018aa-6613-4ac5-83ac-f85e6ec6201a,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:41.388060 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:41.456391 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8331535'] for router_gateway, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.630669 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8332921', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-62478'] for router, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.632868 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.712248 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8332083'] for router, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.712749 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f5f03d8e-8074-4a54-9b67-292c322d1f4f {{(pid=92422) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 16:33:41.725711 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] Notify callbacks [] for router, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.726878 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-87c9b562-d732-4c4b-9274-a94c5e10a315 admin admin] 10.222.0.64 "DELETE /v2.0/routers/f5f03d8e-8074-4a54-9b67-292c322d1f4f HTTP/1.1" status: 204  len: 168 time: 1.5008318
May 20 16:33:41.729511 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41272) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:41.792286 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.db_base_plugin_v2 [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Deleting subnet c09265b7-ec8d-4c31-a44d-34f0aaf15d57 {{(pid=92422) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 16:33:41.795544 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.847923 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6219245'] for subnet, precommit_delete_associations {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:41.921673 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-882775'] for subnet, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.196692 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:42.227497 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-882760', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437284', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6358801', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6223409'] for subnet, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.230950 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:42.231325 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device e6c1dc32-2719-4c4c-b313-b944d4fcaaa9 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:42.231747 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ee2018aa-6613-4ac5-83ac-f85e6ec6201a no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:42.232184 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-0d5cfe2c-1d42-4055-9c31-7bc487d90903 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:42.265105 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c09265b7-ec8d-4c31-a44d-34f0aaf15d57,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:42.268131 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:42.268487 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: ee2018aa-6613-4ac5-83ac-f85e6ec6201a {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:42.268842 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ee2018aa-6613-4ac5-83ac-f85e6ec6201a not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:42.269106 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for subnet, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.278348 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-66e1ae50-c2cd-45c6-826f-08f5b0af4166 admin admin] 10.222.0.64 "DELETE /v2.0/subnets/c09265b7-ec8d-4c31-a44d-34f0aaf15d57 HTTP/1.1" status: 204  len: 168 time: 0.5476058
May 20 16:33:42.278526 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-add2a4ce-19bc-49be-a568-9c200b5af5c4 None None] Network 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e requested from dv-cinder-689486-13-iscsi {{(pid=92423) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 16:33:42.280830 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41276) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:42.383205 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-968463'] for network, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.453226 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Deleting port ab96237e-ff01-4a95-8839-5179d7ad57b1 {{(pid=92422) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:42.453436 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.510368 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] DHCP port deletion for 7f41ce1a-7a56-4bba-ba7c-09fac47ee28e request from dv-cinder-689486-13-iscsi {{(pid=92423) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 16:33:42.553671 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.db [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] For port ab96237e-ff01-4a95-8839-5179d7ad57b1, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ab96237e-ff01-4a95-8839-5179d7ad57b1,segment=NetworkSegment(a1311d2e-3e3b-40e6-b792-506a50d6801e),segment_id=a1311d2e-3e3b-40e6-b792-506a50d6801e)] {{(pid=92422) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:42.554027 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.576851 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] Deleting port ab96237e-ff01-4a95-8839-5179d7ad57b1 {{(pid=92423) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 16:33:42.577228 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789403237843'] for port, before_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.671086 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.db [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] For port ab96237e-ff01-4a95-8839-5179d7ad57b1, host dv-cinder-689486-13-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-689486-13-iscsi',level=0,port_id=ab96237e-ff01-4a95-8839-5179d7ad57b1,segment=NetworkSegment(a1311d2e-3e3b-40e6-b792-506a50d6801e),segment_id=a1311d2e-3e3b-40e6-b792-506a50d6801e)] {{(pid=92423) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 16:33:42.671512 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8300766'] for port, precommit_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.674163 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.plugin [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Calling delete_port for ab96237e-ff01-4a95-8839-5179d7ad57b1 owned by network:dhcp {{(pid=92422) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:42.795174 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] Calling delete_port for ab96237e-ff01-4a95-8839-5179d7ad57b1 owned by network:dhcp {{(pid=92423) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 16:33:42.798525 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6359010'] for port, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.803988 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-dd338f43-951f-4fee-a441-ad8144712ecc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:42.837882 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1000776', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-437339', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8347557', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789403239882', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789402874983'] for port, after_delete {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:42.841703 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:42.888173 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] No DVR routers for this DVR port ab96237e-ff01-4a95-8839-5179d7ad57b1 on host dv-cinder-689486-13-iscsi {{(pid=92423) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:33:42.891873 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] Pushing event deleted for resources: {'Port': ['ID=ab96237e-ff01-4a95-8839-5179d7ad57b1,revision_number=None']} {{(pid=92423) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:42.900010 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG oslo_concurrency.lockutils [None req-72a1ddef-23a4-444f-b069-a52760b1b7fb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:42.953001 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Pushing event deleted for resources: {'Port': ['ID=ab96237e-ff01-4a95-8839-5179d7ad57b1,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:42.955924 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:42.956694 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] No DVR routers for this DVR port ab96237e-ff01-4a95-8839-5179d7ad57b1 on host dv-cinder-689486-13-iscsi {{(pid=92422) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 16:33:43.068425 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-883928', 'neutron.services.segments.db._delete_segments_for_network-8789403297913'] for network, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.080638 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe7135a7220>,) {'filters': {'network_id': ['7f41ce1a-7a56-4bba-ba7c-09fac47ee28e']}} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:43.092313 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7135a7220>, 'a1311d2e-3e3b-40e6-b792-506a50d6801e') {'for_net_delete': True} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:43.092610 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.services.segments.db [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe7135a7220>, 'a1311d2e-3e3b-40e6-b792-506a50d6801e') {} {{(pid=92422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 16:33:43.104274 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789403309559', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6219234'] for segment, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.120411 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484'] for segment, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.126181 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Releasing vlan 642 on physical network physnet1 to pool {{(pid=92422) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 16:33:43.126558 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-880484', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6358967'] for segment, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]: Traceback (most recent call last):
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     timer()
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     cb(*args, **kw)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     return func(*args, **kwargs)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     self._notify()
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     self.callback(batched_events)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     event.method(event)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     return f(self, *a, **k)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._get(url).json()
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     return self.request(url, 'GET', **kwargs)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 16:33:43.139292 dv-cinder-689486-13-iscsi neutron-server[92422]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 16:33:43.288717 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-883921', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-7913628', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-8347578', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8331556'] for network, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.293434 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8347543'] for network, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.298209 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:43.318093 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Pushing event deleted for resources: {'Network': ['ID=7f41ce1a-7a56-4bba-ba7c-09fac47ee28e,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:43.320457 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:43.324035 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b2543584-33ea-44e5-8a5d-5bf9dd8ad574 admin admin] 10.222.0.64 "DELETE /v2.0/networks/7f41ce1a-7a56-4bba-ba7c-09fac47ee28e HTTP/1.1" status: 204  len: 168 time: 1.0422890
May 20 16:33:43.629513 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41282) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:43.678174 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-b5e22274-f26e-4710-a591-55b9b3dfe3e4 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=a6bd88ff65e9420a8ccb36968532c4f6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0472379
May 20 16:33:43.680444 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41286) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:43.740688 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0e593ed-f271-4631-aa7b-741429ee817a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.765908 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0e593ed-f271-4631-aa7b-741429ee817a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.886832 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ab96237e-ff01-4a95-8839-5179d7ad57b1 no longer exists at agent ovs-agent-dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 16:33:43.911010 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0e593ed-f271-4631-aa7b-741429ee817a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.914899 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-7b8d938f-1783-43f7-b8e6-b4a29489f54f tempest-VolumesNegativeTest-1624778687 tempest-VolumesNegativeTest-1624778687-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:43.921256 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.plugin [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] No Port match for: ab96237e-ff01-4a95-8839-5179d7ad57b1 {{(pid=92423) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 16:33:43.921606 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron.plugins.ml2.rpc [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Device ab96237e-ff01-4a95-8839-5179d7ad57b1 not bound to the agent host dv-cinder-689486-13-iscsi {{(pid=92423) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 16:33:43.929774 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e593ed-f271-4631-aa7b-741429ee817a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f24406af-f97d-4ad2-9779-ec228d2091ac,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:43.931990 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-f0e593ed-f271-4631-aa7b-741429ee817a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:43.936988 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-f0e593ed-f271-4631-aa7b-741429ee817a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:43.940428 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-f0e593ed-f271-4631-aa7b-741429ee817a admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/f24406af-f97d-4ad2-9779-ec228d2091ac HTTP/1.1" status: 204  len: 168 time: 0.2568011
May 20 16:33:44.526824 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41294) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:44.575296 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-8cc83fc9-9387-48c6-b2d8-bafd3741deb7 admin admin] 10.222.0.64 "GET /v2.0/security-groups?tenant_id=3c8d0c7d5c7f420f878c3ea95df7af77&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0470822
May 20 16:33:44.577526 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.wsgi [-] (92422) accepted ('10.222.0.64', 41298) {{(pid=92422) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 16:33:44.634708 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90a74e24-3bd3-4f56-a9b9-0797ace98c00 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:44.659414 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90a74e24-3bd3-4f56-a9b9-0797ace98c00 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:44.787485 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90a74e24-3bd3-4f56-a9b9-0797ace98c00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7913550'] for security_group, after_delete {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:44.791228 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-5c48b117-70d4-4acc-b48d-2c90954ed4bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 16:33:44.802135 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a74e24-3bd3-4f56-a9b9-0797ace98c00 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f60fd76-304b-4f6e-b8b2-8accc12c522f,revision_number=None']} {{(pid=92422) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 16:33:44.806814 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG oslo_concurrency.lockutils [None req-90a74e24-3bd3-4f56-a9b9-0797ace98c00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 16:33:44.808447 dv-cinder-689486-13-iscsi neutron-server[92422]: DEBUG neutron_lib.callbacks.manager [None req-90a74e24-3bd3-4f56-a9b9-0797ace98c00 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:44.809569 dv-cinder-689486-13-iscsi neutron-server[92422]: INFO neutron.wsgi [None req-90a74e24-3bd3-4f56-a9b9-0797ace98c00 admin admin] 10.222.0.64 "DELETE /v2.0/security-groups/5f60fd76-304b-4f6e-b8b2-8accc12c522f HTTP/1.1" status: 204  len: 168 time: 0.2311614
May 20 16:33:45.906718 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-21baf93a-4b18-4f53-92b3-31d9e6778305 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:48.449343 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:48.643650 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-47c11c15-28fa-4d22-81f9-c3572a8a3a35 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:49.655466 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:51.329953 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:33:59.426388 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:10.947472 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:34:15.872065 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-d5998d37-2235-484b-8386-86b5df4653a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:18.454699 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:18.652933 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3a6f8111-fd3a-46c7-9d15-5e2a8026da29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:19.694853 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:21.323539 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:29.419836 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:45.916251 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-bbdf41df-335b-433a-b85e-341f9fe15c78 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:47.946249 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:34:48.462500 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:48.645190 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-fd2c1be7-4cd5-4e62-b793-4383f555da52 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:49.679374 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:51.310301 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:34:59.461414 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:15.886229 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-fdc4a25b-5160-400e-ba39-c63acd438257 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:18.474718 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:18.651881 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-48a3b544-279b-4827-a950-8a4496fe5cf4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:19.682872 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:21.320906 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:24.944782 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:35:29.428849 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:45.863995 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4836d1f9-2d83-488e-9f4d-cb7e4b8d1977 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:48.486968 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:48.669720 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-7cde87cb-1cb8-410e-8e8e-7500bf9ed7af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:49.732663 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:51.326677 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:35:59.434779 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:01.944710 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:36:15.879626 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-606bf328-b89e-4739-b987-f7ccfed28a3e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:18.472170 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:18.639316 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4f52aecd-2c72-4a4e-98ed-415193c70043 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:19.673602 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:21.323461 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:29.450119 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:38.943498 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:36:45.883345 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6de26cb8-1f5f-447e-927d-803e7fba17b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:48.471731 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:48.654366 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-fa759d96-7e80-43a3-aecc-55c757b4e49a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:49.700408 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:51.323330 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:36:59.430983 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:15.870069 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-4dd47e6b-83c4-4d29-bbe5-494af37d53c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:15.941937 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:37:18.481813 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:18.635716 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-3e57675b-ce43-4523-9732-771fd384a275 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:19.681420 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:21.338404 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:29.446613 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:45.868643 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f8da3c2-57c3-4564-8a2d-bbae0f1c5538 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:48.497270 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:48.640623 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-a88176e0-d463-41c1-9f88-33ca97dc7b0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:49.680121 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:51.331414 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:37:52.941196 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:37:59.519587 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:15.878113 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-f6d5080a-c2e0-46ad-878f-a061be17a0cd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:18.473420 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:18.644609 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-bc8986ad-8fa4-46bd-af67-bb10081d4574 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:19.719348 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:21.370093 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:29.495690 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:29.940266 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 16:38:45.872737 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-192c30cd-d338-45a6-a471-fb35520169bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:48.500895 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-73960e04-75b3-4be6-aabb-b4a801d2baef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:48.654801 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-6f7b8e65-5a2b-4e0b-8493-8728ba94b7cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:49.683740 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-5e88ab8f-fd89-4d6e-a639-0d46a1de24ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:51.329499 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-8b8114d3-350c-4827-9fbb-03d98223f55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:38:59.493447 dv-cinder-689486-13-iscsi neutron-server[92423]: DEBUG neutron_lib.callbacks.manager [None req-9a39e7d4-7463-44bb-8cff-4307b89913d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789403300940', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-854806'] for agent, after_update {{(pid=92423) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 16:39:06.940384 dv-cinder-689486-13-iscsi neutron-server[92424]: DEBUG neutron.db.agents_db [None req-8a47a6ab-125c-41d6-8ccb-a23ac29ccb54 None None] Agent healthcheck: found 6 active agents {{(pid=92424) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}